2026-02-17T12:12:54.820 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T12:12:54.834 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T12:12:54.910 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51436 branch: wip-bharath20-testing-2026-02-13-0906-squid description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51436' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath20-testing-2026-02-13-0906-squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-bharath20-testing-2026-02-13-0906-squid sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 4581 sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath20-testing-2026-02-13-0906-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 targets: trial155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDb9zAWOdy4fU3low22zkoX2g/4aUVmDBv4laSml0F32qjnEWDPQcAnJ3Y5Xff+/WcjZwKDZJgRPhbid6hbO4w4= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - misc teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:10:36 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T12:12:54.911 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa; will attempt to use it 2026-02-17T12:12:54.911 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks 2026-02-17T12:12:54.911 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T12:12:54.913 INFO:teuthology.task.internal:Checking packages... 2026-02-17T12:12:54.913 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3c96dfb3f50b3d02598a82af7104764bfdcd3919' 2026-02-17T12:12:54.913 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T12:12:54.913 INFO:teuthology.packaging:ref: None 2026-02-17T12:12:54.913 INFO:teuthology.packaging:tag: None 2026-02-17T12:12:54.913 INFO:teuthology.packaging:branch: wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T12:12:54.913 INFO:teuthology.packaging:sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:12:54.913 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T12:12:55.032 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-675.g3c96dfb3 2026-02-17T12:12:55.033 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T12:12:55.045 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T12:12:55.045 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T12:12:55.059 INFO:teuthology.task.internal:Saving configuration 2026-02-17T12:12:55.066 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T12:12:55.081 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T12:12:55.160 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial155.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51436', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 12:09:30.704397', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDb9zAWOdy4fU3low22zkoX2g/4aUVmDBv4laSml0F32qjnEWDPQcAnJ3Y5Xff+/WcjZwKDZJgRPhbid6hbO4w4='} 2026-02-17T12:12:55.160 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T12:12:55.172 INFO:teuthology.task.internal:roles: ubuntu@trial155.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T12:12:55.172 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T12:12:55.258 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x71eb871ae8e0>, signals=[15]) 2026-02-17T12:12:55.258 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T12:12:55.269 INFO:teuthology.task.internal:Opening connections... 2026-02-17T12:12:55.269 DEBUG:teuthology.task.internal:connecting to ubuntu@trial155.front.sepia.ceph.com 2026-02-17T12:12:55.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:12:55.330 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T12:12:55.342 DEBUG:teuthology.orchestra.run.trial155:> uname -m 2026-02-17T12:12:55.400 INFO:teuthology.orchestra.run.trial155.stdout:x86_64 2026-02-17T12:12:55.401 DEBUG:teuthology.orchestra.run.trial155:> cat /etc/os-release 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:NAME="CentOS Stream" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:VERSION="9" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:ID="centos" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:ID_LIKE="rhel fedora" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:VERSION_ID="9" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:PLATFORM_ID="platform:el9" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:ANSI_COLOR="0;31" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:LOGO="fedora-logo-icon" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:HOME_URL="https://centos.org/" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T12:12:55.457 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T12:12:55.458 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T12:12:55.458 INFO:teuthology.lock.ops:Updating trial155.front.sepia.ceph.com on lock server 2026-02-17T12:12:55.543 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T12:12:55.555 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T12:12:55.566 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T12:12:55.567 DEBUG:teuthology.orchestra.run.trial155:> test '!' -e /home/ubuntu/cephtest 2026-02-17T12:12:55.581 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T12:12:55.592 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T12:12:55.592 DEBUG:teuthology.orchestra.run.trial155:> test -z $(ls -A /var/lib/ceph) 2026-02-17T12:12:55.638 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T12:12:55.738 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T12:12:55.758 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T12:12:55.759 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T12:12:55.759 DEBUG:teuthology.orchestra.run.trial155:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T12:12:55.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:12:55.774 DEBUG:teuthology.orchestra.run.trial155:> uname -r 2026-02-17T12:12:55.830 INFO:teuthology.orchestra.run.trial155.stdout:5.14.0-645.el9.x86_64 2026-02-17T12:12:55.831 INFO:teuthology.task.kernel:Running kernel on trial155: 5.14.0-645.el9.x86_64 2026-02-17T12:12:55.831 DEBUG:teuthology.orchestra.run.trial155:> sudo yum install -y kernel 2026-02-17T12:13:00.291 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.9 MB 00:04 2026-02-17T12:13:22.679 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 27 MB 00:21 2026-02-17T12:13:34.241 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 866 kB/s | 7.8 MB 00:09 2026-02-17T12:13:35.449 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 20 kB 00:00 2026-02-17T12:13:35.689 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 115 MB/s | 20 MB 00:00 2026-02-17T12:13:38.850 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-17T12:13:39.857 INFO:teuthology.orchestra.run.trial155.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T12:13:39.877 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:13:39.878 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:13:39.878 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-17T12:13:39.878 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:13:39.879 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-17T12:13:39.879 INFO:teuthology.orchestra.run.trial155.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T12:13:39.879 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-17T12:13:39.879 INFO:teuthology.orchestra.run.trial155.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T12:13:39.879 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T12:13:39.879 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T12:13:39.879 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:13:39.879 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-17T12:13:39.879 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:13:39.879 INFO:teuthology.orchestra.run.trial155.stdout:Install 4 Packages 2026-02-17T12:13:39.879 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:13:39.880 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 88 M 2026-02-17T12:13:39.880 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 135 M 2026-02-17T12:13:39.880 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-17T12:13:40.100 INFO:teuthology.orchestra.run.trial155.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 4.9 MB/s | 803 kB 00:00 2026-02-17T12:13:40.288 INFO:teuthology.orchestra.run.trial155.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 49 MB/s | 17 MB 00:00 2026-02-17T12:13:40.421 INFO:teuthology.orchestra.run.trial155.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 96 MB/s | 31 MB 00:00 2026-02-17T12:13:40.517 INFO:teuthology.orchestra.run.trial155.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 69 MB/s | 40 MB 00:00 2026-02-17T12:13:40.517 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:13:40.518 INFO:teuthology.orchestra.run.trial155.stdout:Total 138 MB/s | 88 MB 00:00 2026-02-17T12:13:40.709 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-17T12:13:40.913 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-17T12:13:40.913 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-17T12:13:41.258 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-17T12:13:41.259 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-17T12:13:42.354 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-17T12:13:42.652 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T12:13:42.670 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T12:13:44.455 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T12:13:44.484 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T12:13:47.508 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T12:13:47.514 INFO:teuthology.orchestra.run.trial155.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:13:50.543 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:14:20.896 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:14:20.917 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:14:20.981 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:14:20.981 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T12:14:20.981 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T12:14:20.981 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T12:14:21.033 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:14:21.033 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:14:21.033 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-17T12:14:21.033 INFO:teuthology.orchestra.run.trial155.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T12:14:21.034 INFO:teuthology.orchestra.run.trial155.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T12:14:21.034 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T12:14:21.034 INFO:teuthology.orchestra.run.trial155.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T12:14:21.034 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:14:21.034 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:14:21.090 DEBUG:teuthology.orchestra.run.trial155:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T12:14:21.116 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T12:14:21.117 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T12:14:21.117 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T12:14:21.117 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T12:14:21.117 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T12:14:21.117 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T12:14:21.117 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial155.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T12:14:21.117 DEBUG:teuthology.orchestra.run.trial155:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T12:14:21.180 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T12:14:21.181 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T12:14:21.181 DEBUG:teuthology.orchestra.run.trial155:> sudo rpm -qi grub2-tools 2026-02-17T12:14:21.248 INFO:teuthology.orchestra.run.trial155.stdout:Name : grub2-tools 2026-02-17T12:14:21.248 INFO:teuthology.orchestra.run.trial155.stdout:Epoch : 1 2026-02-17T12:14:21.248 INFO:teuthology.orchestra.run.trial155.stdout:Version : 2.06 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:Release : 118.el9 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:Architecture: x86_64 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:Group : Unspecified 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:Size : 8393909 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:License : GPLv3+ 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:Packager : builder@centos.org 2026-02-17T12:14:21.249 INFO:teuthology.orchestra.run.trial155.stdout:Vendor : CentOS 2026-02-17T12:14:21.250 INFO:teuthology.orchestra.run.trial155.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T12:14:21.250 INFO:teuthology.orchestra.run.trial155.stdout:Summary : Support tools for GRUB. 2026-02-17T12:14:21.250 INFO:teuthology.orchestra.run.trial155.stdout:Description : 2026-02-17T12:14:21.250 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:14:21.250 INFO:teuthology.orchestra.run.trial155.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T12:14:21.250 INFO:teuthology.orchestra.run.trial155.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T12:14:21.250 INFO:teuthology.orchestra.run.trial155.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T12:14:21.250 INFO:teuthology.orchestra.run.trial155.stdout:hardware devices. 2026-02-17T12:14:21.250 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:14:21.250 INFO:teuthology.orchestra.run.trial155.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T12:14:21.252 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T12:14:21.252 INFO:teuthology.task.kernel:Updating grub on trial155 to boot 5.14.0-681.el9.x86_64 2026-02-17T12:14:21.252 DEBUG:teuthology.orchestra.run.trial155:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T12:14:21.315 INFO:teuthology.orchestra.run.trial155.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T12:14:21.317 DEBUG:teuthology.orchestra.run.trial155:> sudo command -v grubby && echo yes || echo no 2026-02-17T12:14:21.381 INFO:teuthology.orchestra.run.trial155.stdout:/sbin/grubby 2026-02-17T12:14:21.383 INFO:teuthology.orchestra.run.trial155.stdout:yes 2026-02-17T12:14:21.383 DEBUG:teuthology.orchestra.run.trial155:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T12:14:21.448 INFO:teuthology.orchestra.run.trial155.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T12:14:21.449 DEBUG:teuthology.orchestra.run.trial155:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T12:14:21.523 DEBUG:teuthology.orchestra.run.trial155:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T12:14:21.732 INFO:teuthology.orchestra.run.trial155.stderr:Generating grub configuration file ... 2026-02-17T12:14:21.794 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T12:14:21.800 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T12:14:22.049 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T12:14:22.055 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T12:14:22.086 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T12:14:22.093 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T12:14:22.116 INFO:teuthology.orchestra.run.trial155.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T12:14:22.122 INFO:teuthology.orchestra.run.trial155.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T12:14:22.204 INFO:teuthology.orchestra.run.trial155.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T12:14:22.212 INFO:teuthology.orchestra.run.trial155.stderr:done 2026-02-17T12:14:22.214 DEBUG:teuthology.orchestra.run.trial155:> test -d /sys/firmware/efi 2026-02-17T12:14:22.230 DEBUG:teuthology.orchestra.run.trial155:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T12:14:22.295 INFO:teuthology.orchestra.run.trial155.stdout:/boot/efi/EFI/BOOT 2026-02-17T12:14:22.295 INFO:teuthology.orchestra.run.trial155.stdout:/boot/efi/EFI/centos 2026-02-17T12:14:22.297 DEBUG:teuthology.orchestra.run.trial155:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T12:14:22.362 INFO:teuthology.orchestra.run.trial155.stdout:no 2026-02-17T12:14:22.363 DEBUG:teuthology.orchestra.run.trial155:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T12:14:22.426 INFO:teuthology.orchestra.run.trial155.stdout:yes 2026-02-17T12:14:22.426 DEBUG:teuthology.orchestra.run.trial155:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T12:14:22.492 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial155 2026-02-17T12:14:22.492 DEBUG:teuthology.orchestra.run.trial155:> sudo bash -c ' 2026-02-17T12:14:22.492 DEBUG:teuthology.orchestra.run.trial155:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T12:14:22.492 DEBUG:teuthology.orchestra.run.trial155:> ' 2026-02-17T12:14:52.534 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T12:14:52.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-17T12:14:52.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:15:06.816 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.155 2026-02-17T12:15:15.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-17T12:15:15.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:15:51.772 DEBUG:teuthology.orchestra.run.trial155:> true 2026-02-17T12:15:51.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-17T12:15:51.916 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T12:15:51.916 DEBUG:teuthology.orchestra.run.trial155:> uname -r 2026-02-17T12:15:51.972 INFO:teuthology.orchestra.run.trial155.stdout:5.14.0-681.el9.x86_64 2026-02-17T12:15:51.972 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T12:15:51.972 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T12:15:51.972 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T12:15:52.974 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T12:15:52.974 DEBUG:teuthology.orchestra.run.trial155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T12:15:53.004 INFO:teuthology.orchestra.run.trial155.stdout:ttyS1 2026-02-17T12:15:53.029 DEBUG:teuthology.parallel:result is None 2026-02-17T12:15:53.029 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T12:15:53.040 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T12:15:53.040 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T12:15:53.086 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T12:15:53.097 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T12:15:53.112 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T12:15:53.113 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T12:15:53.153 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T12:15:53.163 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T12:15:53.164 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T12:15:53.208 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:15:53.217 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:15:53.218 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T12:15:53.230 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T12:15:53.230 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T12:15:53.283 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T12:15:53.299 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T12:15:53.300 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T12:15:53.339 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:15:53.482 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:15:53.507 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:15:53.641 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:15:53.665 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-17T12:15:53.665 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T12:15:53.731 DEBUG:teuthology.orchestra.run.trial155:> sudo service rsyslog restart 2026-02-17T12:15:53.801 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:15:53.960 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T12:15:53.971 INFO:teuthology.task.internal:Starting timer... 2026-02-17T12:15:53.971 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T12:15:53.987 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T12:15:53.999 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T12:15:53.999 DEBUG:teuthology.orchestra.run.trial155:> sudo service auditd rotate 2026-02-17T12:15:54.028 INFO:teuthology.orchestra.run.trial155.stdout:Rotating logs: 2026-02-17T12:15:54.029 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T12:15:54.030 DEBUG:teuthology.orchestra.run.trial155:> /usr/sbin/getenforce 2026-02-17T12:15:54.086 INFO:teuthology.orchestra.run.trial155.stdout:Permissive 2026-02-17T12:15:54.086 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial155.front.sepia.ceph.com': 'permissive'} 2026-02-17T12:15:54.086 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:15:54.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:15:54.150 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T12:15:54.150 DEBUG:teuthology.orchestra.run.trial155:> sudo /usr/sbin/setenforce permissive 2026-02-17T12:15:54.213 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T12:15:54.226 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T12:15:54.235 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T12:15:54.236 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T12:18:34.198 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial155.front.sepia.ceph.com')] 2026-02-17T12:18:34.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-17T12:18:34.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:18:34.310 DEBUG:teuthology.orchestra.run.trial155:> true 2026-02-17T12:18:34.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-17T12:18:34.387 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T12:18:34.402 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T12:18:34.403 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T12:18:34.404 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:18:34.456 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T12:18:34.467 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T12:18:34.488 INFO:teuthology.orchestra.run.trial155.stderr:sudo: ntpd: command not found 2026-02-17T12:18:34.498 INFO:teuthology.orchestra.run.trial155.stdout:506 Cannot talk to daemon 2026-02-17T12:18:34.509 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T12:18:34.520 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T12:18:34.565 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:18:34.567 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:18:34.567 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-17T12:18:34.568 INFO:teuthology.run_tasks:Running task install... 2026-02-17T12:18:34.583 DEBUG:teuthology.task.install:project ceph 2026-02-17T12:18:34.583 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}} 2026-02-17T12:18:34.583 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T12:18:34.583 INFO:teuthology.task.install:Using flavor: default 2026-02-17T12:18:34.592 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T12:18:34.592 INFO:teuthology.task.install:extra packages: [] 2026-02-17T12:18:34.593 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T12:18:34.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:18:34.759 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T12:18:34.760 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T12:18:34.882 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T12:18:34.882 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-17T12:18:34.882 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T12:18:34.909 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T12:18:34.909 DEBUG:teuthology.orchestra.run.trial155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T12:18:34.974 DEBUG:teuthology.orchestra.run.trial155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T12:18:35.047 DEBUG:teuthology.orchestra.run.trial155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T12:18:35.112 INFO:teuthology.orchestra.run.trial155.stdout:check_obsoletes = 1 2026-02-17T12:18:35.113 DEBUG:teuthology.orchestra.run.trial155:> sudo yum clean all 2026-02-17T12:18:35.261 INFO:teuthology.orchestra.run.trial155.stdout:41 files removed 2026-02-17T12:18:35.276 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-radosgw 2026-02-17T12:18:35.543 INFO:teuthology.orchestra.run.trial155.stdout:ceph packages for x86_64 680 kB/s | 86 kB 00:00 2026-02-17T12:18:35.674 INFO:teuthology.orchestra.run.trial155.stdout:ceph noarch packages 114 kB/s | 12 kB 00:00 2026-02-17T12:18:35.798 INFO:teuthology.orchestra.run.trial155.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T12:18:44.427 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-17T12:18:48.069 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 27 MB 00:03 2026-02-17T12:18:51.936 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-17T12:18:53.785 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-17T12:18:54.750 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2026-02-17T12:18:57.975 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-17T12:18:59.185 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:18:59.187 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:18:59.187 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-17T12:18:59.187 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:18:59.187 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-17T12:18:59.187 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T12:18:59.187 INFO:teuthology.orchestra.run.trial155.stdout:Upgrading: 2026-02-17T12:18:59.187 INFO:teuthology.orchestra.run.trial155.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T12:18:59.187 INFO:teuthology.orchestra.run.trial155.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T12:18:59.188 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T12:18:59.189 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout:Installing weak dependencies: 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-17T12:18:59.190 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:18:59.191 INFO:teuthology.orchestra.run.trial155.stdout:Install 33 Packages 2026-02-17T12:18:59.191 INFO:teuthology.orchestra.run.trial155.stdout:Upgrade 2 Packages 2026-02-17T12:18:59.191 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:18:59.191 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 63 M 2026-02-17T12:18:59.191 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-17T12:18:59.837 INFO:teuthology.orchestra.run.trial155.stdout:(1/35): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 13 MB/s | 5.5 MB 00:00 2026-02-17T12:18:59.883 INFO:teuthology.orchestra.run.trial155.stdout:(2/35): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 549 kB/s | 25 kB 00:00 2026-02-17T12:18:59.950 INFO:teuthology.orchestra.run.trial155.stdout:(3/35): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 15 MB/s | 999 kB 00:00 2026-02-17T12:19:00.009 INFO:teuthology.orchestra.run.trial155.stdout:(4/35): libradosstriper1-19.2.3-675.g3c96dfb3.e 8.3 MB/s | 503 kB 00:00 2026-02-17T12:19:00.059 INFO:teuthology.orchestra.run.trial155.stdout:(5/35): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 16 MB/s | 11 MB 00:00 2026-02-17T12:19:00.111 INFO:teuthology.orchestra.run.trial155.stdout:(6/35): python3-ceph-argparse-19.2.3-675.g3c96d 858 kB/s | 45 kB 00:00 2026-02-17T12:19:00.167 INFO:teuthology.orchestra.run.trial155.stdout:(7/35): python3-ceph-common-19.2.3-675.g3c96dfb 2.5 MB/s | 142 kB 00:00 2026-02-17T12:19:00.225 INFO:teuthology.orchestra.run.trial155.stdout:(8/35): python3-cephfs-19.2.3-675.g3c96dfb3.el9 2.7 MB/s | 165 kB 00:00 2026-02-17T12:19:00.290 INFO:teuthology.orchestra.run.trial155.stdout:(9/35): python3-rados-19.2.3-675.g3c96dfb3.el9. 4.9 MB/s | 322 kB 00:00 2026-02-17T12:19:00.299 INFO:teuthology.orchestra.run.trial155.stdout:(10/35): librgw2-19.2.3-675.g3c96dfb3.el9.x86_6 19 MB/s | 5.4 MB 00:00 2026-02-17T12:19:00.330 INFO:teuthology.orchestra.run.trial155.stdout:(11/35): ceph-common-19.2.3-675.g3c96dfb3.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T12:19:00.331 INFO:teuthology.orchestra.run.trial155.stdout:(12/35): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 3.0 MB/s | 100 kB 00:00 2026-02-17T12:19:00.332 INFO:teuthology.orchestra.run.trial155.stdout:(13/35): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 7.0 MB/s | 303 kB 00:00 2026-02-17T12:19:00.401 INFO:teuthology.orchestra.run.trial155.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 473 kB/s | 33 kB 00:00 2026-02-17T12:19:00.432 INFO:teuthology.orchestra.run.trial155.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 931 kB/s | 93 kB 00:00 2026-02-17T12:19:00.524 INFO:teuthology.orchestra.run.trial155.stdout:(16/35): nvme-cli-2.13-1.el9.x86_64.rpm 5.7 MB/s | 1.1 MB 00:00 2026-02-17T12:19:01.137 INFO:teuthology.orchestra.run.trial155.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 141 kB/s | 104 kB 00:00 2026-02-17T12:19:01.256 INFO:teuthology.orchestra.run.trial155.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 199 kB/s | 164 kB 00:00 2026-02-17T12:19:01.261 INFO:teuthology.orchestra.run.trial155.stdout:(19/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 217 kB/s | 160 kB 00:00 2026-02-17T12:19:01.301 INFO:teuthology.orchestra.run.trial155.stdout:(20/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 277 kB/s | 45 kB 00:00 2026-02-17T12:19:01.707 INFO:teuthology.orchestra.run.trial155.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 589 kB/s | 240 kB 00:00 2026-02-17T12:19:01.752 INFO:teuthology.orchestra.run.trial155.stdout:(22/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 596 kB/s | 292 kB 00:00 2026-02-17T12:19:01.872 INFO:teuthology.orchestra.run.trial155.stdout:(23/35): qatlib-service-25.08.0-2.el9.x86_64.rp 225 kB/s | 37 kB 00:00 2026-02-17T12:19:01.917 INFO:teuthology.orchestra.run.trial155.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 401 kB/s | 66 kB 00:00 2026-02-17T12:19:02.079 INFO:teuthology.orchestra.run.trial155.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.4 MB/s | 308 kB 00:00 2026-02-17T12:19:02.106 INFO:teuthology.orchestra.run.trial155.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 920 kB/s | 25 kB 00:00 2026-02-17T12:19:02.135 INFO:teuthology.orchestra.run.trial155.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 1.7 MB/s | 49 kB 00:00 2026-02-17T12:19:02.146 INFO:teuthology.orchestra.run.trial155.stdout:(28/35): librdkafka-1.6.1-102.el9.x86_64.rpm 744 kB/s | 662 kB 00:00 2026-02-17T12:19:02.169 INFO:teuthology.orchestra.run.trial155.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2026-02-17T12:19:02.182 INFO:teuthology.orchestra.run.trial155.stdout:(30/35): libarrow-9.0.0-15.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2026-02-17T12:19:02.207 INFO:teuthology.orchestra.run.trial155.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 4.9 MB/s | 191 kB 00:00 2026-02-17T12:19:02.213 INFO:teuthology.orchestra.run.trial155.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 52 MB/s | 1.6 MB 00:00 2026-02-17T12:19:02.322 INFO:teuthology.orchestra.run.trial155.stdout:(33/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.7 MB/s | 838 kB 00:00 2026-02-17T12:19:02.399 INFO:teuthology.orchestra.run.trial155.stdout:(34/35): librados2-19.2.3-675.g3c96dfb3.el9.x86 18 MB/s | 3.4 MB 00:00 2026-02-17T12:19:02.403 INFO:teuthology.orchestra.run.trial155.stdout:(35/35): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 17 MB/s | 3.2 MB 00:00 2026-02-17T12:19:02.407 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:19:02.407 INFO:teuthology.orchestra.run.trial155.stdout:Total 20 MB/s | 63 MB 00:03 2026-02-17T12:19:02.507 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-17T12:19:02.526 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-17T12:19:02.527 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-17T12:19:02.763 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-17T12:19:02.764 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-17T12:19:03.053 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-17T12:19:03.061 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T12:19:03.063 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T12:19:03.075 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T12:19:03.228 INFO:teuthology.orchestra.run.trial155.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T12:19:03.232 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T12:19:03.259 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T12:19:03.302 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T12:19:03.303 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T12:19:03.314 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T12:19:03.318 INFO:teuthology.orchestra.run.trial155.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T12:19:03.327 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/37 2026-02-17T12:19:03.350 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T12:19:03.350 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T12:19:03.363 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T12:19:03.396 INFO:teuthology.orchestra.run.trial155.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T12:19:03.399 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T12:19:03.405 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T12:19:03.408 INFO:teuthology.orchestra.run.trial155.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T12:19:03.411 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T12:19:03.415 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T12:19:03.559 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T12:19:03.560 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T12:19:03.586 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T12:19:03.588 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/37 2026-02-17T12:19:03.594 INFO:teuthology.orchestra.run.trial155.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T12:19:03.823 INFO:teuthology.orchestra.run.trial155.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T12:19:03.824 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T12:19:03.840 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T12:19:03.843 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/37 2026-02-17T12:19:03.847 INFO:teuthology.orchestra.run.trial155.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T12:19:03.850 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T12:19:03.850 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T12:19:03.870 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T12:19:03.982 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T12:19:03.984 INFO:teuthology.orchestra.run.trial155.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T12:19:04.260 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T12:19:04.260 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T12:19:04.260 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:04.295 INFO:teuthology.orchestra.run.trial155.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T12:19:04.296 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 31/37 2026-02-17T12:19:05.296 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T12:19:05.298 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T12:19:05.583 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T12:19:05.586 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T12:19:05.623 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T12:19:05.623 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T12:19:05.623 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T12:19:05.624 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:05.627 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T12:19:10.178 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T12:19:10.178 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /sys 2026-02-17T12:19:10.178 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /proc 2026-02-17T12:19:10.178 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /mnt 2026-02-17T12:19:10.178 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /var/tmp 2026-02-17T12:19:10.179 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /home 2026-02-17T12:19:10.179 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /root 2026-02-17T12:19:10.179 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /tmp 2026-02-17T12:19:10.179 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:10.639 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T12:19:10.662 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T12:19:10.662 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:19:10.662 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T12:19:10.663 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:19:10.663 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:19:10.663 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:10.664 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T12:19:10.677 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T12:19:10.677 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T12:19:10.732 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T12:19:10.733 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'qat' with GID 992. 2026-02-17T12:19:10.733 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:10.998 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/37 2026-02-17T12:19:10.998 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/37 2026-02-17T12:19:10.998 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T12:19:10.999 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T12:19:11.000 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T12:19:11.001 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T12:19:11.001 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T12:19:11.001 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T12:19:11.001 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T12:19:11.001 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T12:19:11.001 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T12:19:11.001 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T12:19:11.001 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 36/37 2026-02-17T12:19:11.060 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T12:19:11.060 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:11.060 INFO:teuthology.orchestra.run.trial155.stdout:Upgraded: 2026-02-17T12:19:11.060 INFO:teuthology.orchestra.run.trial155.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.060 INFO:teuthology.orchestra.run.trial155.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.060 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-17T12:19:11.060 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T12:19:11.060 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.061 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.062 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.063 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:11.063 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T12:19:11.063 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T12:19:11.063 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T12:19:11.063 INFO:teuthology.orchestra.run.trial155.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T12:19:11.063 INFO:teuthology.orchestra.run.trial155.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T12:19:11.063 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:11.063 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:11.102 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-test 2026-02-17T12:19:11.411 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:14 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:11.494 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:11.495 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:11.495 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-17T12:19:11.495 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:11.495 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-17T12:19:11.495 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T12:19:11.496 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-17T12:19:11.496 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T12:19:11.496 INFO:teuthology.orchestra.run.trial155.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T12:19:11.496 INFO:teuthology.orchestra.run.trial155.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T12:19:11.496 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T12:19:11.496 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:11.496 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-17T12:19:11.496 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:11.496 INFO:teuthology.orchestra.run.trial155.stdout:Install 5 Packages 2026-02-17T12:19:11.496 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:11.496 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 50 M 2026-02-17T12:19:11.497 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 212 M 2026-02-17T12:19:11.497 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-17T12:19:11.691 INFO:teuthology.orchestra.run.trial155.stdout:(1/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T12:19:12.398 INFO:teuthology.orchestra.run.trial155.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 294 kB/s | 233 kB 00:00 2026-02-17T12:19:12.447 INFO:teuthology.orchestra.run.trial155.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 401 kB/s | 303 kB 00:00 2026-02-17T12:19:12.617 INFO:teuthology.orchestra.run.trial155.stdout:(4/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T12:19:12.618 INFO:teuthology.orchestra.run.trial155.stdout:(5/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 289 kB/s | 64 kB 00:00 2026-02-17T12:19:12.620 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:19:12.620 INFO:teuthology.orchestra.run.trial155.stdout:Total 45 MB/s | 50 MB 00:01 2026-02-17T12:19:12.648 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-17T12:19:12.658 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-17T12:19:12.658 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-17T12:19:12.844 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-17T12:19:12.844 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-17T12:19:13.055 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-17T12:19:13.061 INFO:teuthology.orchestra.run.trial155.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T12:19:13.065 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T12:19:13.073 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T12:19:13.073 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T12:19:15.322 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T12:19:15.339 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T12:19:15.556 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T12:19:15.556 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T12:19:15.556 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T12:19:15.557 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T12:19:15.557 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T12:19:15.612 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T12:19:15.612 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:15.612 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-17T12:19:15.612 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:15.612 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:15.612 INFO:teuthology.orchestra.run.trial155.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T12:19:15.612 INFO:teuthology.orchestra.run.trial155.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T12:19:15.612 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T12:19:15.612 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:15.613 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:15.645 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph 2026-02-17T12:19:15.955 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:18 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:16.042 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:16.044 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-17T12:19:16.044 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-17T12:19:16.045 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-17T12:19:16.045 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-17T12:19:16.045 INFO:teuthology.orchestra.run.trial155.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T12:19:16.045 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-17T12:19:16.045 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T12:19:16.045 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T12:19:16.045 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T12:19:16.045 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T12:19:16.045 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T12:19:16.045 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T12:19:16.045 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T12:19:16.046 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T12:19:16.047 INFO:teuthology.orchestra.run.trial155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T12:19:16.047 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T12:19:16.047 INFO:teuthology.orchestra.run.trial155.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T12:19:16.047 INFO:teuthology.orchestra.run.trial155.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T12:19:16.047 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T12:19:16.047 INFO:teuthology.orchestra.run.trial155.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T12:19:16.047 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T12:19:16.047 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T12:19:16.047 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T12:19:16.047 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T12:19:16.047 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T12:19:16.048 INFO:teuthology.orchestra.run.trial155.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T12:19:16.049 INFO:teuthology.orchestra.run.trial155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T12:19:16.050 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T12:19:16.051 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout:Installing weak dependencies: 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T12:19:16.052 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T12:19:16.053 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T12:19:16.053 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T12:19:16.053 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T12:19:16.053 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T12:19:16.053 INFO:teuthology.orchestra.run.trial155.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T12:19:16.053 INFO:teuthology.orchestra.run.trial155.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T12:19:16.053 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:16.053 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-17T12:19:16.053 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-17T12:19:16.053 INFO:teuthology.orchestra.run.trial155.stdout:Install 99 Packages 2026-02-17T12:19:16.053 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:16.054 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 95 M 2026-02-17T12:19:16.054 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 520 M 2026-02-17T12:19:16.054 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-17T12:19:16.749 INFO:teuthology.orchestra.run.trial155.stdout:(1/99): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 123 kB/s | 6.5 kB 00:00 2026-02-17T12:19:16.813 INFO:teuthology.orchestra.run.trial155.stdout:(2/99): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 9.1 MB/s | 1.1 MB 00:00 2026-02-17T12:19:16.880 INFO:teuthology.orchestra.run.trial155.stdout:(3/99): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 13 MB/s | 2.4 MB 00:00 2026-02-17T12:19:16.918 INFO:teuthology.orchestra.run.trial155.stdout:(4/99): ceph-grafana-dashboards-19.2.3-675.g3c9 827 kB/s | 31 kB 00:00 2026-02-17T12:19:16.961 INFO:teuthology.orchestra.run.trial155.stdout:(5/99): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 3.5 MB/s | 150 kB 00:00 2026-02-17T12:19:17.013 INFO:teuthology.orchestra.run.trial155.stdout:(6/99): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 18 MB/s | 4.7 MB 00:00 2026-02-17T12:19:17.160 INFO:teuthology.orchestra.run.trial155.stdout:(7/99): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 19 MB/s | 3.8 MB 00:00 2026-02-17T12:19:17.209 INFO:teuthology.orchestra.run.trial155.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 452 kB/s | 22 kB 00:00 2026-02-17T12:19:17.265 INFO:teuthology.orchestra.run.trial155.stdout:(9/99): ceph-mgr-modules-core-19.2.3-675.g3c96d 4.4 MB/s | 253 kB 00:00 2026-02-17T12:19:17.319 INFO:teuthology.orchestra.run.trial155.stdout:(10/99): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 910 kB/s | 49 kB 00:00 2026-02-17T12:19:17.370 INFO:teuthology.orchestra.run.trial155.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-6 21 MB/s | 7.4 MB 00:00 2026-02-17T12:19:17.370 INFO:teuthology.orchestra.run.trial155.stdout:(12/99): ceph-prometheus-alerts-19.2.3-675.g3c9 327 kB/s | 17 kB 00:00 2026-02-17T12:19:17.407 INFO:teuthology.orchestra.run.trial155.stdout:(13/99): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 7.8 MB/s | 299 kB 00:00 2026-02-17T12:19:17.422 INFO:teuthology.orchestra.run.trial155.stdout:(14/99): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 15 MB/s | 769 kB 00:00 2026-02-17T12:19:17.449 INFO:teuthology.orchestra.run.trial155.stdout:(15/99): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 27 MB/s | 17 MB 00:00 2026-02-17T12:19:17.701 INFO:teuthology.orchestra.run.trial155.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 145 kB/s | 40 kB 00:00 2026-02-17T12:19:17.806 INFO:teuthology.orchestra.run.trial155.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 202 kB/s | 72 kB 00:00 2026-02-17T12:19:17.952 INFO:teuthology.orchestra.run.trial155.stdout:(18/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 644 kB/s | 350 kB 00:00 2026-02-17T12:19:18.037 INFO:teuthology.orchestra.run.trial155.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 799 kB/s | 184 kB 00:00 2026-02-17T12:19:18.068 INFO:teuthology.orchestra.run.trial155.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2026-02-17T12:19:18.138 INFO:teuthology.orchestra.run.trial155.stdout:(21/99): libgfortran-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 794 kB 00:00 2026-02-17T12:19:18.162 INFO:teuthology.orchestra.run.trial155.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2026-02-17T12:19:18.226 INFO:teuthology.orchestra.run.trial155.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 1.5 MB/s | 135 kB 00:00 2026-02-17T12:19:18.263 INFO:teuthology.orchestra.run.trial155.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 1.5 MB/s | 150 kB 00:00 2026-02-17T12:19:18.312 INFO:teuthology.orchestra.run.trial155.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 1.4 MB/s | 126 kB 00:00 2026-02-17T12:19:18.353 INFO:teuthology.orchestra.run.trial155.stdout:(26/99): python3-cryptography-36.0.1-5.el9.x86_ 3.9 MB/s | 1.2 MB 00:00 2026-02-17T12:19:18.374 INFO:teuthology.orchestra.run.trial155.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 1.9 MB/s | 218 kB 00:00 2026-02-17T12:19:18.394 INFO:teuthology.orchestra.run.trial155.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 1.5 MB/s | 30 kB 00:00 2026-02-17T12:19:18.401 INFO:teuthology.orchestra.run.trial155.stdout:(29/99): unzip-6.0-59.el9.x86_64.rpm 2.0 MB/s | 182 kB 00:00 2026-02-17T12:19:18.412 INFO:teuthology.orchestra.run.trial155.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 1.4 MB/s | 15 kB 00:00 2026-02-17T12:19:18.421 INFO:teuthology.orchestra.run.trial155.stdout:(31/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 110 MB/s | 3.0 MB 00:00 2026-02-17T12:19:18.427 INFO:teuthology.orchestra.run.trial155.stdout:(32/99): lua-5.4.4-4.el9.x86_64.rpm 30 MB/s | 188 kB 00:00 2026-02-17T12:19:18.428 INFO:teuthology.orchestra.run.trial155.stdout:(33/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 15 MB/s | 246 kB 00:00 2026-02-17T12:19:18.432 INFO:teuthology.orchestra.run.trial155.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 9.8 MB/s | 42 kB 00:00 2026-02-17T12:19:18.441 INFO:teuthology.orchestra.run.trial155.stdout:(35/99): zip-3.0-35.el9.x86_64.rpm 2.9 MB/s | 266 kB 00:00 2026-02-17T12:19:18.443 INFO:teuthology.orchestra.run.trial155.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 91 MB/s | 1.0 MB 00:00 2026-02-17T12:19:18.451 INFO:teuthology.orchestra.run.trial155.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 29 MB/s | 244 kB 00:00 2026-02-17T12:19:18.460 INFO:teuthology.orchestra.run.trial155.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 27 MB/s | 249 kB 00:00 2026-02-17T12:19:18.467 INFO:teuthology.orchestra.run.trial155.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 27 MB/s | 177 kB 00:00 2026-02-17T12:19:18.525 INFO:teuthology.orchestra.run.trial155.stdout:(40/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 21 MB/s | 1.2 MB 00:00 2026-02-17T12:19:18.534 INFO:teuthology.orchestra.run.trial155.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 19 MB/s | 172 kB 00:00 2026-02-17T12:19:18.541 INFO:teuthology.orchestra.run.trial155.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 4.4 MB/s | 35 kB 00:00 2026-02-17T12:19:18.557 INFO:teuthology.orchestra.run.trial155.stdout:(43/99): python3-babel-2.9.1-2.el9.noarch.rpm 51 MB/s | 6.0 MB 00:00 2026-02-17T12:19:18.572 INFO:teuthology.orchestra.run.trial155.stdout:(44/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 37 MB/s | 5.3 MB 00:00 2026-02-17T12:19:18.573 INFO:teuthology.orchestra.run.trial155.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 27 MB/s | 442 kB 00:00 2026-02-17T12:19:18.582 INFO:teuthology.orchestra.run.trial155.stdout:(46/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 151 MB/s | 6.1 MB 00:00 2026-02-17T12:19:18.583 INFO:teuthology.orchestra.run.trial155.stdout:(47/99): python3-packaging-20.9-5.el9.noarch.rp 7.1 MB/s | 77 kB 00:00 2026-02-17T12:19:18.586 INFO:teuthology.orchestra.run.trial155.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 21 MB/s | 267 kB 00:00 2026-02-17T12:19:18.590 INFO:teuthology.orchestra.run.trial155.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 21 MB/s | 159 kB 00:00 2026-02-17T12:19:18.591 INFO:teuthology.orchestra.run.trial155.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 10 MB/s | 54 kB 00:00 2026-02-17T12:19:18.593 INFO:teuthology.orchestra.run.trial155.stdout:(51/99): python3-pyasn1-modules-0.4.8-6.el9.noa 27 MB/s | 279 kB 00:00 2026-02-17T12:19:18.596 INFO:teuthology.orchestra.run.trial155.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 9.0 MB/s | 42 kB 00:00 2026-02-17T12:19:18.600 INFO:teuthology.orchestra.run.trial155.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 26 MB/s | 189 kB 00:00 2026-02-17T12:19:18.601 INFO:teuthology.orchestra.run.trial155.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 20 MB/s | 90 kB 00:00 2026-02-17T12:19:18.654 INFO:teuthology.orchestra.run.trial155.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 418 kB/s | 22 kB 00:00 2026-02-17T12:19:18.686 INFO:teuthology.orchestra.run.trial155.stdout:(56/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 201 MB/s | 19 MB 00:00 2026-02-17T12:19:18.769 INFO:teuthology.orchestra.run.trial155.stdout:(57/99): protobuf-compiler-3.14.0-17.el9.x86_64 5.0 MB/s | 862 kB 00:00 2026-02-17T12:19:18.780 INFO:teuthology.orchestra.run.trial155.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 207 kB/s | 19 kB 00:00 2026-02-17T12:19:18.858 INFO:teuthology.orchestra.run.trial155.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.6 MB/s | 551 kB 00:00 2026-02-17T12:19:18.888 INFO:teuthology.orchestra.run.trial155.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 984 kB/s | 29 kB 00:00 2026-02-17T12:19:18.918 INFO:teuthology.orchestra.run.trial155.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 1.9 MB/s | 60 kB 00:00 2026-02-17T12:19:18.932 INFO:teuthology.orchestra.run.trial155.stdout:(62/99): luarocks-3.9.2-5.el9.noarch.rpm 931 kB/s | 151 kB 00:00 2026-02-17T12:19:18.944 INFO:teuthology.orchestra.run.trial155.stdout:(63/99): python3-asyncssh-2.13.2-5.el9.noarch.r 3.3 MB/s | 548 kB 00:00 2026-02-17T12:19:18.948 INFO:teuthology.orchestra.run.trial155.stdout:(64/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.4 MB/s | 43 kB 00:00 2026-02-17T12:19:18.966 INFO:teuthology.orchestra.run.trial155.stdout:(65/99): python3-cachetools-4.2.4-1.el9.noarch. 950 kB/s | 32 kB 00:00 2026-02-17T12:19:18.976 INFO:teuthology.orchestra.run.trial155.stdout:(66/99): python3-certifi-2023.05.07-4.el9.noarc 436 kB/s | 14 kB 00:00 2026-02-17T12:19:18.977 INFO:teuthology.orchestra.run.trial155.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 5.8 MB/s | 173 kB 00:00 2026-02-17T12:19:19.011 INFO:teuthology.orchestra.run.trial155.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 7.2 MB/s | 254 kB 00:00 2026-02-17T12:19:19.035 INFO:teuthology.orchestra.run.trial155.stdout:(69/99): python3-cherrypy-18.6.1-2.el9.noarch.r 5.1 MB/s | 358 kB 00:00 2026-02-17T12:19:19.045 INFO:teuthology.orchestra.run.trial155.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 4.1 MB/s | 144 kB 00:00 2026-02-17T12:19:19.071 INFO:teuthology.orchestra.run.trial155.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 3.8 MB/s | 139 kB 00:00 2026-02-17T12:19:19.078 INFO:teuthology.orchestra.run.trial155.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 1.7 MB/s | 56 kB 00:00 2026-02-17T12:19:19.095 INFO:teuthology.orchestra.run.trial155.stdout:(73/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 17 MB/s | 2.0 MB 00:00 2026-02-17T12:19:19.104 INFO:teuthology.orchestra.run.trial155.stdout:(74/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 320 kB/s | 11 kB 00:00 2026-02-17T12:19:19.111 INFO:teuthology.orchestra.run.trial155.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 545 kB/s | 18 kB 00:00 2026-02-17T12:19:19.125 INFO:teuthology.orchestra.run.trial155.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 778 kB/s | 23 kB 00:00 2026-02-17T12:19:19.138 INFO:teuthology.orchestra.run.trial155.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 585 kB/s | 20 kB 00:00 2026-02-17T12:19:19.143 INFO:teuthology.orchestra.run.trial155.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 602 kB/s | 19 kB 00:00 2026-02-17T12:19:19.155 INFO:teuthology.orchestra.run.trial155.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 893 kB/s | 26 kB 00:00 2026-02-17T12:19:19.176 INFO:teuthology.orchestra.run.trial155.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2026-02-17T12:19:19.185 INFO:teuthology.orchestra.run.trial155.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 2.6 MB/s | 79 kB 00:00 2026-02-17T12:19:19.210 INFO:teuthology.orchestra.run.trial155.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.5 MB/s | 86 kB 00:00 2026-02-17T12:19:19.215 INFO:teuthology.orchestra.run.trial155.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 1.9 MB/s | 58 kB 00:00 2026-02-17T12:19:19.222 INFO:teuthology.orchestra.run.trial155.stdout:(84/99): python3-kubernetes-26.1.0-3.el9.noarch 12 MB/s | 1.0 MB 00:00 2026-02-17T12:19:19.245 INFO:teuthology.orchestra.run.trial155.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 7.6 MB/s | 272 kB 00:00 2026-02-17T12:19:19.245 INFO:teuthology.orchestra.run.trial155.stdout:(86/99): python3-portend-3.1.0-2.el9.noarch.rpm 549 kB/s | 16 kB 00:00 2026-02-17T12:19:19.256 INFO:teuthology.orchestra.run.trial155.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.5 MB/s | 90 kB 00:00 2026-02-17T12:19:19.275 INFO:teuthology.orchestra.run.trial155.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 1.0 MB/s | 31 kB 00:00 2026-02-17T12:19:19.281 INFO:teuthology.orchestra.run.trial155.stdout:(89/99): python3-routes-2.5.1-5.el9.noarch.rpm 5.2 MB/s | 188 kB 00:00 2026-02-17T12:19:19.291 INFO:teuthology.orchestra.run.trial155.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2026-02-17T12:19:19.307 INFO:teuthology.orchestra.run.trial155.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 3.9 MB/s | 125 kB 00:00 2026-02-17T12:19:19.313 INFO:teuthology.orchestra.run.trial155.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 1.1 MB/s | 36 kB 00:00 2026-02-17T12:19:19.326 INFO:teuthology.orchestra.run.trial155.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 2.5 MB/s | 86 kB 00:00 2026-02-17T12:19:19.339 INFO:teuthology.orchestra.run.trial155.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 7.0 MB/s | 230 kB 00:00 2026-02-17T12:19:19.347 INFO:teuthology.orchestra.run.trial155.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2026-02-17T12:19:19.368 INFO:teuthology.orchestra.run.trial155.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 9.8 MB/s | 427 kB 00:00 2026-02-17T12:19:19.369 INFO:teuthology.orchestra.run.trial155.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.6 MB/s | 48 kB 00:00 2026-02-17T12:19:19.381 INFO:teuthology.orchestra.run.trial155.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 658 kB/s | 22 kB 00:00 2026-02-17T12:19:19.402 INFO:teuthology.orchestra.run.trial155.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 595 kB/s | 20 kB 00:00 2026-02-17T12:19:19.402 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:19:19.402 INFO:teuthology.orchestra.run.trial155.stdout:Total 28 MB/s | 95 MB 00:03 2026-02-17T12:19:19.832 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-17T12:19:19.869 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-17T12:19:19.870 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-17T12:19:20.287 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-17T12:19:20.288 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-17T12:19:20.737 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-17T12:19:20.739 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T12:19:20.770 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T12:19:20.775 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T12:19:20.797 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T12:19:20.802 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T12:19:20.835 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T12:19:20.844 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T12:19:20.849 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T12:19:20.852 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T12:19:20.856 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T12:19:20.879 INFO:teuthology.orchestra.run.trial155.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T12:19:20.892 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T12:19:20.895 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T12:19:20.901 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T12:19:20.903 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T12:19:20.914 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T12:19:20.920 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T12:19:20.945 INFO:teuthology.orchestra.run.trial155.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T12:19:20.948 INFO:teuthology.orchestra.run.trial155.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T12:19:20.955 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T12:19:20.979 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T12:19:21.031 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T12:19:21.044 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T12:19:21.046 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T12:19:21.051 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T12:19:21.056 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T12:19:21.061 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T12:19:21.064 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T12:19:21.079 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T12:19:21.100 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T12:19:21.105 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T12:19:21.110 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T12:19:21.121 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T12:19:21.130 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T12:19:21.137 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T12:19:21.156 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T12:19:21.165 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T12:19:21.220 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T12:19:21.232 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T12:19:21.248 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T12:19:21.253 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T12:19:21.261 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T12:19:21.301 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T12:19:21.628 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T12:19:21.638 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T12:19:21.642 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T12:19:21.648 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T12:19:21.650 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T12:19:21.677 INFO:teuthology.orchestra.run.trial155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T12:19:21.721 INFO:teuthology.orchestra.run.trial155.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T12:19:21.728 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T12:19:21.731 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T12:19:21.737 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T12:19:21.740 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T12:19:21.747 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T12:19:21.751 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T12:19:21.779 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T12:19:21.789 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T12:19:21.824 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T12:19:22.050 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T12:19:22.074 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T12:19:22.077 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T12:19:22.136 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T12:19:22.138 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T12:19:22.159 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T12:19:22.487 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T12:19:22.561 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T12:19:23.237 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T12:19:23.254 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T12:19:23.264 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T12:19:23.271 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T12:19:23.284 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T12:19:23.300 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T12:19:23.376 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T12:19:23.385 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T12:19:23.409 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T12:19:23.438 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T12:19:23.489 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T12:19:23.495 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T12:19:23.499 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T12:19:23.500 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T12:19:23.518 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T12:19:23.518 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T12:19:23.518 INFO:teuthology.orchestra.run.trial155.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T12:19:23.518 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:23.527 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T12:19:23.553 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T12:19:23.553 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T12:19:23.553 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:23.591 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T12:19:23.656 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T12:19:23.658 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T12:19:23.672 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T12:19:23.672 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:19:23.672 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T12:19:23.672 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:24.370 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T12:19:24.394 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T12:19:24.394 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:19:24.394 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T12:19:24.394 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T12:19:24.395 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T12:19:24.395 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:24.448 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T12:19:24.450 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T12:19:24.455 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 88/99 2026-02-17T12:19:24.474 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 89/99 2026-02-17T12:19:24.476 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T12:19:24.968 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T12:19:24.971 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T12:19:25.424 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T12:19:25.425 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T12:19:25.437 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T12:19:25.437 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T12:19:25.492 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T12:19:25.541 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 94/99 2026-02-17T12:19:25.542 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T12:19:25.563 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T12:19:25.563 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:19:25.563 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T12:19:25.563 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T12:19:25.564 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T12:19:25.564 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:25.575 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T12:19:25.792 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T12:19:25.794 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T12:19:25.815 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T12:19:25.816 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:19:25.816 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T12:19:25.816 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T12:19:25.816 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T12:19:25.816 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:25.916 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T12:19:25.937 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T12:19:25.937 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:19:25.937 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T12:19:25.937 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T12:19:25.937 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T12:19:25.937 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:25.955 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T12:19:26.649 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T12:19:26.649 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/99 2026-02-17T12:19:26.649 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/99 2026-02-17T12:19:26.649 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/99 2026-02-17T12:19:26.649 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/99 2026-02-17T12:19:26.649 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/99 2026-02-17T12:19:26.649 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/99 2026-02-17T12:19:26.649 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T12:19:26.650 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T12:19:26.651 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T12:19:26.652 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T12:19:26.652 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T12:19:26.652 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T12:19:26.652 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T12:19:26.652 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T12:19:26.652 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T12:19:26.652 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T12:19:26.652 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T12:19:26.652 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T12:19:26.652 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T12:19:26.652 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T12:19:26.718 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T12:19:26.718 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:26.718 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-17T12:19:26.718 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:26.719 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T12:19:26.720 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T12:19:26.721 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T12:19:26.721 INFO:teuthology.orchestra.run.trial155.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T12:19:26.721 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T12:19:26.721 INFO:teuthology.orchestra.run.trial155.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T12:19:26.721 INFO:teuthology.orchestra.run.trial155.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T12:19:26.721 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T12:19:26.721 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T12:19:26.721 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T12:19:26.721 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T12:19:26.721 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T12:19:26.722 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T12:19:26.722 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T12:19:26.722 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T12:19:26.722 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T12:19:26.722 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T12:19:26.722 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T12:19:26.722 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T12:19:26.722 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T12:19:26.722 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T12:19:26.722 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T12:19:26.722 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T12:19:26.723 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T12:19:26.723 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T12:19:26.723 INFO:teuthology.orchestra.run.trial155.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T12:19:26.723 INFO:teuthology.orchestra.run.trial155.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T12:19:26.723 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T12:19:26.723 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T12:19:26.723 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T12:19:26.723 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T12:19:26.723 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T12:19:26.723 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T12:19:26.723 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T12:19:26.724 INFO:teuthology.orchestra.run.trial155.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T12:19:26.725 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T12:19:26.725 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T12:19:26.725 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T12:19:26.725 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T12:19:26.725 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T12:19:26.725 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T12:19:26.725 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T12:19:26.725 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T12:19:26.725 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T12:19:26.725 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T12:19:26.726 INFO:teuthology.orchestra.run.trial155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T12:19:26.727 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T12:19:26.727 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T12:19:26.727 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T12:19:26.727 INFO:teuthology.orchestra.run.trial155.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T12:19:26.727 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T12:19:26.727 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T12:19:26.727 INFO:teuthology.orchestra.run.trial155.stdout: zip-3.0-35.el9.x86_64 2026-02-17T12:19:26.727 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:26.727 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:26.773 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-base 2026-02-17T12:19:27.078 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:27.141 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:19:27.158 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:27.159 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:27.159 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:27.180 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install cephadm 2026-02-17T12:19:27.485 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:27.548 INFO:teuthology.orchestra.run.trial155.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:19:27.566 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:27.566 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:27.566 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:27.587 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T12:19:27.896 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:27.978 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:27.978 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:27.978 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-17T12:19:27.978 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:27.978 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-17T12:19:27.978 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T12:19:27.979 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:27.979 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-17T12:19:27.979 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:27.979 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-17T12:19:27.979 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:27.979 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 145 k 2026-02-17T12:19:27.979 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 431 k 2026-02-17T12:19:27.979 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-17T12:19:28.063 INFO:teuthology.orchestra.run.trial155.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.7 MB/s | 145 kB 00:00 2026-02-17T12:19:28.064 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:19:28.064 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-17T12:19:28.064 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-17T12:19:28.067 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-17T12:19:28.067 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-17T12:19:28.100 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-17T12:19:28.100 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-17T12:19:28.155 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-17T12:19:28.156 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:19:28.179 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:19:28.179 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:19:28.179 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T12:19:28.179 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:28.476 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:19:28.476 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:28.476 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-17T12:19:28.476 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:28.476 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:28.476 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:28.503 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr 2026-02-17T12:19:28.815 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:28.879 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:19:28.896 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:28.897 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:28.897 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:28.919 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T12:19:29.233 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:29.298 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:19:29.316 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:29.316 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:29.316 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:29.338 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T12:19:29.649 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:29.713 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:19:29.731 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:29.731 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:29.732 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:29.753 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-rook 2026-02-17T12:19:30.062 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:30.126 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:19:30.143 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:30.144 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:30.144 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:30.164 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T12:19:30.475 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:30.540 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:19:30.557 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:30.558 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:30.558 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:30.581 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-fuse 2026-02-17T12:19:30.888 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:30.970 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:30.970 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:30.970 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-17T12:19:30.971 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:30.971 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-17T12:19:30.971 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T12:19:30.971 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:30.971 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-17T12:19:30.971 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:30.971 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-17T12:19:30.971 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:30.971 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 1.2 M 2026-02-17T12:19:30.971 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 3.6 M 2026-02-17T12:19:30.971 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-17T12:19:31.089 INFO:teuthology.orchestra.run.trial155.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 9.8 MB/s | 1.2 MB 00:00 2026-02-17T12:19:31.089 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:19:31.089 INFO:teuthology.orchestra.run.trial155.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-17T12:19:31.089 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-17T12:19:31.093 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-17T12:19:31.093 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-17T12:19:31.127 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-17T12:19:31.127 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-17T12:19:31.228 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-17T12:19:31.245 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:31.485 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:31.541 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:31.542 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:31.542 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-17T12:19:31.542 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:31.542 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:31.542 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:31.568 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-volume 2026-02-17T12:19:31.879 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:31.943 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:19:31.960 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:31.961 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:31.961 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:31.982 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados-devel 2026-02-17T12:19:32.294 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:32.375 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:32.376 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:32.376 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-17T12:19:32.376 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:32.376 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-17T12:19:32.376 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T12:19:32.376 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:32.376 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-17T12:19:32.377 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:32.377 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-17T12:19:32.377 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:32.377 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 127 k 2026-02-17T12:19:32.377 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 456 k 2026-02-17T12:19:32.377 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-17T12:19:32.461 INFO:teuthology.orchestra.run.trial155.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 1.5 MB/s | 127 kB 00:00 2026-02-17T12:19:32.461 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:19:32.461 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.5 MB/s | 127 kB 00:00 2026-02-17T12:19:32.462 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-17T12:19:32.464 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-17T12:19:32.464 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-17T12:19:32.495 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-17T12:19:32.495 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-17T12:19:32.549 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-17T12:19:32.566 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:32.650 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:32.707 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:32.708 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:32.708 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-17T12:19:32.708 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:32.708 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:32.708 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:32.735 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install libcephfs2 2026-02-17T12:19:33.051 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:33.114 INFO:teuthology.orchestra.run.trial155.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:19:33.131 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:33.132 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:33.132 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:33.154 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install libcephfs-devel 2026-02-17T12:19:33.467 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:33.549 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:33.549 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:33.550 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-17T12:19:33.550 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:33.550 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-17T12:19:33.550 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T12:19:33.550 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:33.550 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-17T12:19:33.550 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:33.550 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-17T12:19:33.550 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:33.551 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 34 k 2026-02-17T12:19:33.551 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 153 k 2026-02-17T12:19:33.551 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-17T12:19:33.613 INFO:teuthology.orchestra.run.trial155.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 535 kB/s | 34 kB 00:00 2026-02-17T12:19:33.613 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:19:33.614 INFO:teuthology.orchestra.run.trial155.stdout:Total 526 kB/s | 34 kB 00:00 2026-02-17T12:19:33.614 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-17T12:19:33.615 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-17T12:19:33.615 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-17T12:19:33.617 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-17T12:19:33.617 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-17T12:19:33.638 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-17T12:19:33.653 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:33.712 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:33.769 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:33.769 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:33.769 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-17T12:19:33.770 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:33.770 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:33.770 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:33.795 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados2 2026-02-17T12:19:34.105 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:34.169 INFO:teuthology.orchestra.run.trial155.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:19:34.187 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:34.187 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:34.188 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:34.209 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librbd1 2026-02-17T12:19:34.522 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:34.586 INFO:teuthology.orchestra.run.trial155.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:19:34.603 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:34.604 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:34.604 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:34.627 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rados 2026-02-17T12:19:34.944 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:35.008 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:19:35.025 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:35.026 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:35.026 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:35.048 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rgw 2026-02-17T12:19:35.360 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:35.424 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:19:35.441 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:35.441 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:35.441 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:35.464 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-cephfs 2026-02-17T12:19:35.773 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:35.838 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:19:35.855 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:35.856 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:35.856 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:35.877 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rbd 2026-02-17T12:19:36.188 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:36.252 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:19:36.270 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:36.270 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-17T12:19:36.271 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:36.293 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-fuse 2026-02-17T12:19:36.603 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:36.686 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:36.686 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:36.686 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-17T12:19:36.686 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:36.686 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-17T12:19:36.687 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T12:19:36.687 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:36.687 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-17T12:19:36.687 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:36.687 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-17T12:19:36.687 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:36.687 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 85 k 2026-02-17T12:19:36.687 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 227 k 2026-02-17T12:19:36.687 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-17T12:19:36.760 INFO:teuthology.orchestra.run.trial155.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T12:19:36.761 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:19:36.761 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T12:19:36.761 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-17T12:19:36.764 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-17T12:19:36.764 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-17T12:19:36.796 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-17T12:19:36.797 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-17T12:19:36.849 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-17T12:19:36.866 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:36.946 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:37.004 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:37.004 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:37.004 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-17T12:19:37.004 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:37.004 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:37.004 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:37.033 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-mirror 2026-02-17T12:19:37.351 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 3.1 M 2026-02-17T12:19:37.432 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 13 M 2026-02-17T12:19:37.433 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-17T12:19:37.583 INFO:teuthology.orchestra.run.trial155.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T12:19:37.583 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:19:37.584 INFO:teuthology.orchestra.run.trial155.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T12:19:37.584 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-17T12:19:37.587 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-17T12:19:37.588 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-17T12:19:37.627 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-17T12:19:37.627 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-17T12:19:37.820 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-17T12:19:37.821 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:37.844 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:37.845 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:19:37.845 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T12:19:37.845 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T12:19:37.845 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T12:19:37.845 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:38.143 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:38.143 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:38.143 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-17T12:19:38.143 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:38.144 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:38.144 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:38.171 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-nbd 2026-02-17T12:19:38.483 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 12:18:57 PM UTC. 2026-02-17T12:19:38.566 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-17T12:19:38.566 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:38.567 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-17T12:19:38.567 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:38.567 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-17T12:19:38.567 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T12:19:38.567 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:38.567 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-17T12:19:38.567 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-17T12:19:38.567 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-17T12:19:38.567 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:38.568 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 171 k 2026-02-17T12:19:38.568 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 490 k 2026-02-17T12:19:38.568 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-17T12:19:38.652 INFO:teuthology.orchestra.run.trial155.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T12:19:38.652 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:19:38.652 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-17T12:19:38.652 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-17T12:19:38.656 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-17T12:19:38.656 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-17T12:19:38.686 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-17T12:19:38.687 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-17T12:19:38.742 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-17T12:19:38.759 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:38.837 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:38.894 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:19:38.894 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:38.894 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-17T12:19:38.894 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:19:38.894 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-17T12:19:38.894 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-17T12:19:38.929 DEBUG:teuthology.parallel:result is None 2026-02-17T12:19:38.929 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:19:39.096 DEBUG:teuthology.orchestra.run.trial155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T12:19:39.117 INFO:teuthology.orchestra.run.trial155.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T12:19:39.118 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T12:19:39.118 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T12:19:39.120 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T12:19:39.120 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-17T12:19:39.120 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T12:19:39.182 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T12:19:39.182 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-17T12:19:39.182 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T12:19:39.246 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T12:19:39.310 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T12:19:39.310 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-17T12:19:39.310 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T12:19:39.374 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T12:19:39.436 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T12:19:39.437 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-17T12:19:39.437 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T12:19:39.500 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T12:19:39.567 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T12:19:39.596 INFO:tasks.workunit:Pulling workunits from ref 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:19:39.597 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T12:19:39.597 INFO:tasks.workunit:timeout=3h 2026-02-17T12:19:39.597 INFO:tasks.workunit:cleanup=True 2026-02-17T12:19:39.598 DEBUG:teuthology.orchestra.run.trial155:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T12:19:39.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:19:39.625 INFO:teuthology.orchestra.run.trial155.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T12:19:39.625 DEBUG:teuthology.orchestra.run.trial155:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T12:19:39.681 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T12:19:39.681 DEBUG:teuthology.orchestra.run.trial155:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T12:19:39.740 DEBUG:teuthology.orchestra.run.trial155:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:19:39.802 INFO:tasks.workunit.client.0.trial155.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T12:19:58.981 INFO:tasks.workunit.client.0.trial155.stderr:Note: switching to '3c96dfb3f50b3d02598a82af7104764bfdcd3919'. 2026-02-17T12:19:58.981 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-17T12:19:58.981 INFO:tasks.workunit.client.0.trial155.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T12:19:58.981 INFO:tasks.workunit.client.0.trial155.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T12:19:58.981 INFO:tasks.workunit.client.0.trial155.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T12:19:58.981 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-17T12:19:58.981 INFO:tasks.workunit.client.0.trial155.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T12:19:58.981 INFO:tasks.workunit.client.0.trial155.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T12:19:58.981 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-17T12:19:58.982 INFO:tasks.workunit.client.0.trial155.stderr: git switch -c 2026-02-17T12:19:58.982 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-17T12:19:58.982 INFO:tasks.workunit.client.0.trial155.stderr:Or undo this operation with: 2026-02-17T12:19:58.982 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-17T12:19:58.982 INFO:tasks.workunit.client.0.trial155.stderr: git switch - 2026-02-17T12:19:58.982 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-17T12:19:58.982 INFO:tasks.workunit.client.0.trial155.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T12:19:58.982 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-17T12:19:58.982 INFO:tasks.workunit.client.0.trial155.stderr:HEAD is now at 3c96dfb3f50 Merge branch 'wip-ifed-non-spatial-alloc-squi' of https://github.com/ifed01/ceph into wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T12:19:58.988 DEBUG:teuthology.orchestra.run.trial155:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T12:19:59.046 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-17T12:19:59.046 DEBUG:teuthology.orchestra.run.trial155:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T12:19:59.102 INFO:tasks.workunit:Running workunits matching misc on client.0... 2026-02-17T12:19:59.103 INFO:tasks.workunit:Running workunit misc/mclock-config.sh... 2026-02-17T12:19:59.104 DEBUG:teuthology.orchestra.run.trial155:workunit test misc/mclock-config.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c96dfb3f50b3d02598a82af7104764bfdcd3919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh 2026-02-17T12:19:59.165 INFO:tasks.workunit.client.0.trial155.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T12:19:59.170 INFO:tasks.workunit.client.0.trial155.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T12:19:59.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:19:59.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:19:59.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/mclock-config 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:21: run: local dir=td/mclock-config 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:22: run: shift 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:24: run: export CEPH_MON=127.0.0.1:7124 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:24: run: CEPH_MON=127.0.0.1:7124 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:25: run: export CEPH_ARGS 2026-02-17T12:19:59.171 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:26: run: uuidgen 2026-02-17T12:19:59.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:26: run: CEPH_ARGS+='--fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none ' 2026-02-17T12:19:59.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7124 ' 2026-02-17T12:19:59.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:28: run: CEPH_ARGS+='--debug-mclock 20 ' 2026-02-17T12:19:59.172 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:30: run: set 2026-02-17T12:19:59.172 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:30: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T12:19:59.174 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:30: run: local 'funcs=TEST_backfill_limit_adjustment_mclock 2026-02-17T12:19:59.174 INFO:tasks.workunit.client.0.trial155.stderr:TEST_profile_builtin_to_custom 2026-02-17T12:19:59.174 INFO:tasks.workunit.client.0.trial155.stderr:TEST_profile_custom_to_builtin 2026-02-17T12:19:59.174 INFO:tasks.workunit.client.0.trial155.stderr:TEST_profile_disallow_builtin_params_modify 2026-02-17T12:19:59.174 INFO:tasks.workunit.client.0.trial155.stderr:TEST_profile_disallow_builtin_params_override 2026-02-17T12:19:59.174 INFO:tasks.workunit.client.0.trial155.stderr:TEST_recovery_limit_adjustment_mclock' 2026-02-17T12:19:59.174 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-17T12:19:59.174 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/mclock-config 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/mclock-config 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:19:59.175 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:19:59.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:19:59.177 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:19:59.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:19:59.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:19:59.177 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:19:59.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:19:59.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:19:59.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:19:59.177 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:19:59.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:19:59.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:19:59.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:19:59.179 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:19:59.180 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:19:59.180 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:19:59.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:19:59.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:19:59.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:19:59.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/mclock-config 2026-02-17T12:19:59.181 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:19:59.182 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:19:59.182 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:19:59.182 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37494 2026-02-17T12:19:59.184 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:19:59.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T12:19:59.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T12:19:59.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:19:59.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_backfill_limit_adjustment_mclock td/mclock-config 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:236: TEST_backfill_limit_adjustment_mclock: local dir=td/mclock-config 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:238: TEST_backfill_limit_adjustment_mclock: setup td/mclock-config 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/mclock-config 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/mclock-config 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:19:59.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:19:59.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:19:59.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:19:59.186 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:19:59.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:19:59.187 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:19:59.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:19:59.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:19:59.188 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:19:59.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:19:59.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:19:59.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:19:59.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:19:59.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:19:59.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:19:59.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:19:59.191 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:19:59.191 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:19:59.191 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:19:59.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:19:59.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:19:59.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:19:59.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/mclock-config 2026-02-17T12:19:59.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:19:59.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:19:59.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:19:59.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37494 2026-02-17T12:19:59.194 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:19:59.195 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:19:59.195 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:19:59.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-17T12:19:59.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:239: TEST_backfill_limit_adjustment_mclock: run_mon td/mclock-config a 2026-02-17T12:19:59.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/mclock-config 2026-02-17T12:19:59.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:19:59.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:19:59.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:19:59.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/mclock-config/a 2026-02-17T12:19:59.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-17T12:19:59.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:19:59.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:19:59.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:19:59.222 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:19:59.222 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:19:59.222 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:19:59.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:19:59.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:19:59.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:19:59.249 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:19:59.249 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:19:59.249 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:19:59.249 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:19:59.249 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:19:59.249 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:19:59.249 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:19:59.249 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:19:59.249 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:19:59.250 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:19:59.250 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:19:59.250 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:19:59.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:19:59.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get fsid 2026-02-17T12:19:59.293 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:19:59.293 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:19:59.293 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:19:59.293 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:19:59.293 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:19:59.293 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:19:59.293 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:19:59.294 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:19:59.294 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:19:59.295 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:19:59.295 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:19:59.295 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:19:59.295 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:19:59.295 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get mon_host 2026-02-17T12:19:59.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:240: TEST_backfill_limit_adjustment_mclock: run_mgr td/mclock-config x 2026-02-17T12:19:59.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/mclock-config 2026-02-17T12:19:59.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:19:59.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:19:59.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:19:59.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/mclock-config/x 2026-02-17T12:19:59.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:19:59.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:19:59.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:19:59.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:19:59.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:19:59.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:19:59.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:19:59.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:19:59.435 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:19:59.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:19:59.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:242: TEST_backfill_limit_adjustment_mclock: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-17T12:19:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/mclock-config 2026-02-17T12:19:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:19:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:19:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:19:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/mclock-config/0 2026-02-17T12:19:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-17T12:19:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:19:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:19:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:19:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:19:59.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/mclock-config/0 2026-02-17T12:19:59.456 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:19:59.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c2bff801-4fc4-4337-a40b-bce2a5835de4 2026-02-17T12:19:59.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 c2bff801-4fc4-4337-a40b-bce2a5835de4' 2026-02-17T12:19:59.458 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 c2bff801-4fc4-4337-a40b-bce2a5835de4 2026-02-17T12:19:59.458 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:19:59.465 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDvXJRpK/GjGxAAL50X5Ie2mlX8oAfLY8WqgA== 2026-02-17T12:19:59.465 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDvXJRpK/GjGxAAL50X5Ie2mlX8oAfLY8WqgA=="}' 2026-02-17T12:19:59.465 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c2bff801-4fc4-4337-a40b-bce2a5835de4 -i td/mclock-config/0/new.json 2026-02-17T12:19:59.564 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:19:59.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/mclock-config/0/new.json 2026-02-17T12:19:59.571 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQDvXJRpK/GjGxAAL50X5Ie2mlX8oAfLY8WqgA== --osd-uuid c2bff801-4fc4-4337-a40b-bce2a5835de4 2026-02-17T12:19:59.589 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:19:59.587+0000 7fcd97584780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:19:59.590 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:19:59.589+0000 7fcd97584780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:19:59.591 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:19:59.590+0000 7fcd97584780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:19:59.592 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:19:59.590+0000 7fcd97584780 -1 bdev(0x5573f2e41c00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:19:59.592 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:19:59.590+0000 7fcd97584780 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-17T12:20:02.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-17T12:20:02.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:20:02.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:20:02.245 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:20:02.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:20:02.501 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:20:02.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:20:02.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-17T12:20:02.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:20:02.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:20:02.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:20:02.518 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:02.517+0000 7f5a5aad5780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:02.520 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:02.518+0000 7f5a5aad5780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:02.520 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:02.519+0000 7f5a5aad5780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:02.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:20:02.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:20:02.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:20:02.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:20:02.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:20:02.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:02.692 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:20:02.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:20:02.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:02.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:02.879 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:03.880 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:03.880 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:03.881 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:20:03.881 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:20:03.881 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:03.881 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:04.070 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:04.112 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:04.110+0000 7f5a5aad5780 -1 Falling back to public interface 2026-02-17T12:20:05.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:05.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:05.072 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:20:05.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:20:05.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:05.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:05.259 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:06.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:06.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:06.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:20:06.261 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:20:06.262 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:06.262 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:06.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:07.058 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:07.057+0000 7f5a5aad5780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:20:07.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:07.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:07.450 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:20:07.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:20:07.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:07.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:07.640 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2097096922,v1:127.0.0.1:6803/2097096922] [v2:127.0.0.1:6804/2097096922,v1:127.0.0.1:6805/2097096922] exists,up c2bff801-4fc4-4337-a40b-bce2a5835de4 2026-02-17T12:20:07.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:20:07.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:20:07.642 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:20:07.642 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: jq .osd_max_backfills 2026-02-17T12:20:07.642 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: bc 2026-02-17T12:20:07.642 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:20:07.642 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:07.642 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:07.642 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:07.642 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:07.642 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:07.642 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:07.643 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:20:07.643 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_max_backfills 2026-02-17T12:20:07.688 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:244: TEST_backfill_limit_adjustment_mclock: local backfills=1 2026-02-17T12:20:07.689 INFO:tasks.workunit.client.0.trial155.stdout:osd_max_backfills: 1 2026-02-17T12:20:07.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:246: TEST_backfill_limit_adjustment_mclock: echo 'osd_max_backfills: 1' 2026-02-17T12:20:07.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:251: TEST_backfill_limit_adjustment_mclock: ceph config set osd.0 osd_max_backfills 20 2026-02-17T12:20:07.879 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:252: TEST_backfill_limit_adjustment_mclock: sleep 2 2026-02-17T12:20:09.882 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: jq .osd_max_backfills 2026-02-17T12:20:09.882 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: bc 2026-02-17T12:20:09.883 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:20:09.883 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:09.883 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:09.883 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:09.883 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:09.883 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:09.884 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:09.884 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:20:09.884 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_max_backfills 2026-02-17T12:20:09.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:254: TEST_backfill_limit_adjustment_mclock: local max_backfills=1 2026-02-17T12:20:09.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:255: TEST_backfill_limit_adjustment_mclock: test 1 = 1 2026-02-17T12:20:09.934 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: jq .local_reservations.max_allowed 2026-02-17T12:20:09.934 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: bc 2026-02-17T12:20:09.934 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:20:09.934 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:09.934 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:09.934 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:09.934 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:09.934 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:09.935 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:09.935 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:20:09.935 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok dump_recovery_reservations 2026-02-17T12:20:09.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:259: TEST_backfill_limit_adjustment_mclock: max_backfills=1 2026-02-17T12:20:09.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:260: TEST_backfill_limit_adjustment_mclock: test 1 = 1 2026-02-17T12:20:09.982 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: jq .remote_reservations.max_allowed 2026-02-17T12:20:09.982 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: bc 2026-02-17T12:20:09.982 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:20:09.983 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:09.983 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:09.983 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:09.983 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:09.983 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:09.983 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:09.983 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:20:09.983 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok dump_recovery_reservations 2026-02-17T12:20:10.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:262: TEST_backfill_limit_adjustment_mclock: max_backfills=1 2026-02-17T12:20:10.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:263: TEST_backfill_limit_adjustment_mclock: test 1 = 1 2026-02-17T12:20:10.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:267: TEST_backfill_limit_adjustment_mclock: ceph config set osd.0 osd_mclock_override_recovery_settings true 2026-02-17T12:20:10.219 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:268: TEST_backfill_limit_adjustment_mclock: ceph config set osd.0 osd_max_backfills 20 2026-02-17T12:20:10.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:269: TEST_backfill_limit_adjustment_mclock: sleep 2 2026-02-17T12:20:12.408 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: jq .osd_max_backfills 2026-02-17T12:20:12.409 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: bc 2026-02-17T12:20:12.410 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:20:12.410 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:12.410 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:12.411 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:12.411 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:12.411 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:12.411 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:12.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:20:12.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_max_backfills 2026-02-17T12:20:12.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:271: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-17T12:20:12.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:272: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-17T12:20:12.462 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: jq .local_reservations.max_allowed 2026-02-17T12:20:12.462 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: bc 2026-02-17T12:20:12.462 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:20:12.462 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:12.462 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:12.462 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:12.462 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:12.463 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:12.463 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:12.463 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:20:12.463 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok dump_recovery_reservations 2026-02-17T12:20:12.510 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:276: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-17T12:20:12.510 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:277: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-17T12:20:12.512 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: jq .remote_reservations.max_allowed 2026-02-17T12:20:12.512 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: bc 2026-02-17T12:20:12.512 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:20:12.512 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:12.512 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:12.512 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:12.512 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:12.512 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:12.513 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:12.513 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:20:12.513 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok dump_recovery_reservations 2026-02-17T12:20:12.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:279: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-17T12:20:12.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:280: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-17T12:20:12.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:284: TEST_backfill_limit_adjustment_mclock: kill_daemons td/mclock-config TERM osd 2026-02-17T12:20:12.560 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:12.560 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:12.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:12.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:12.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:13.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:13.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:285: TEST_backfill_limit_adjustment_mclock: ceph osd down 0 2026-02-17T12:20:14.052 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 is already down. 2026-02-17T12:20:14.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:286: TEST_backfill_limit_adjustment_mclock: wait_for_osd down 0 2026-02-17T12:20:14.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=down 2026-02-17T12:20:14.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:20:14.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:20:14.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:20:14.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:14.060 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:20:14.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:20:14.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:14.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 down' 2026-02-17T12:20:14.244 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 down in weight 1 up_from 5 up_thru 0 down_at 6 last_clean_interval [0,0) [v2:127.0.0.1:6802/2097096922,v1:127.0.0.1:6803/2097096922] [v2:127.0.0.1:6804/2097096922,v1:127.0.0.1:6805/2097096922] exists c2bff801-4fc4-4337-a40b-bce2a5835de4 2026-02-17T12:20:14.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:20:14.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:20:14.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:20:14.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:287: TEST_backfill_limit_adjustment_mclock: activate_osd td/mclock-config 0 --osd-op-queue=mclock_scheduler 2026-02-17T12:20:14.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/mclock-config 2026-02-17T12:20:14.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/mclock-config/0 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:20:14.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-17T12:20:14.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:20:14.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:20:14.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:20:14.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:20:14.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:20:14.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+=--osd-op-queue=mclock_scheduler 2026-02-17T12:20:14.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/mclock-config/0 2026-02-17T12:20:14.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T12:20:14.251 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:20:14.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-op-queue=mclock_scheduler 2026-02-17T12:20:14.252 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/mclock-config/0/whoami 2026-02-17T12:20:14.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T12:20:14.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:20:14.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:20:14.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:20:14.262 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:14.261+0000 7fd76fefe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:14.263 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:14.262+0000 7fd76fefe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:14.264 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:14.263+0000 7fd76fefe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:14.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T12:20:14.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:20:14.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:20:14.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:20:14.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:20:14.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:14.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:20:14.439 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:20:14.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:14.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:14.620 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:15.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:15.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:15.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:20:15.622 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:20:15.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:15.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:15.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:15.854 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:15.852+0000 7fd76fefe780 -1 Falling back to public interface 2026-02-17T12:20:16.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:16.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:16.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:20:16.818 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:20:16.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:16.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:17.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:18.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:18.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:18.010 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:20:18.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:20:18.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:18.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:18.195 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:18.557 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:18.555+0000 7fd76fefe780 -1 osd.0 6 log_to_monitors true 2026-02-17T12:20:19.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:19.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:19.197 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:20:19.198 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:20:19.198 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:19.198 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:19.387 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 8 up_thru 0 down_at 6 last_clean_interval [5,6) [v2:127.0.0.1:6802/2182429448,v1:127.0.0.1:6803/2182429448] [v2:127.0.0.1:6804/2182429448,v1:127.0.0.1:6805/2182429448] exists,up c2bff801-4fc4-4337-a40b-bce2a5835de4 2026-02-17T12:20:19.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:20:19.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:20:19.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:20:19.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: jq .osd_max_backfills 2026-02-17T12:20:19.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: bc 2026-02-17T12:20:19.389 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:20:19.389 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:19.389 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:19.389 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:19.389 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.389 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.389 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:19.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:20:19.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_max_backfills 2026-02-17T12:20:19.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:290: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-17T12:20:19.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:291: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-17T12:20:19.438 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: jq .local_reservations.max_allowed 2026-02-17T12:20:19.438 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: bc 2026-02-17T12:20:19.438 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:20:19.438 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:19.438 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:19.438 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:19.438 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.438 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.438 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:19.438 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:20:19.439 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok dump_recovery_reservations 2026-02-17T12:20:19.483 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:295: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-17T12:20:19.483 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:296: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-17T12:20:19.484 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: jq .remote_reservations.max_allowed 2026-02-17T12:20:19.485 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: bc 2026-02-17T12:20:19.485 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:20:19.485 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:19.485 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:19.485 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:19.485 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.485 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.485 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:19.485 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:20:19.485 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok dump_recovery_reservations 2026-02-17T12:20:19.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:298: TEST_backfill_limit_adjustment_mclock: max_backfills=20 2026-02-17T12:20:19.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:299: TEST_backfill_limit_adjustment_mclock: test 20 = 20 2026-02-17T12:20:19.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:301: TEST_backfill_limit_adjustment_mclock: teardown td/mclock-config 2026-02-17T12:20:19.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:20:19.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:20:19.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:20:19.533 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:19.533 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:19.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:19.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:19.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:19.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:19.639 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:20:19.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:20:19.640 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:20:19.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:20:19.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:20:19.642 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:20:19.642 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:19.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:20:19.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:20:19.643 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:19.644 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:20:19.645 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:20:19.645 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:20:19.648 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:20:19.649 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.649 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:20:19.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:20:19.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:20:19.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-17T12:20:19.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:20:19.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:20:19.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:20:19.651 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:19.651 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:19.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:19.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:19.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:19.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:19.652 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:20:19.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:20:19.653 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:20:19.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:20:19.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:20:19.654 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:20:19.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:19.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:20:19.656 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:20:19.656 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:19.656 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:20:19.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:20:19.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:20:19.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:20:19.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:20:19.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:20:19.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:20:19.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-17T12:20:19.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-17T12:20:19.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/mclock-config 2026-02-17T12:20:19.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/mclock-config 2026-02-17T12:20:19.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:20:19.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:20:19.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:20:19.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:19.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:19.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:19.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:19.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:19.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:19.662 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:20:19.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:20:19.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:20:19.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:20:19.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:20:19.664 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:20:19.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:19.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:20:19.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:20:19.665 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:19.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:20:19.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:20:19.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:20:19.668 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:20:19.668 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.668 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:20:19.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:20:19.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:20:19.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/mclock-config 2026-02-17T12:20:19.670 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:20:19.670 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.670 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37494 2026-02-17T12:20:19.671 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:20:19.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:20:19.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:20:19.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-17T12:20:19.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_profile_builtin_to_custom td/mclock-config 2026-02-17T12:20:19.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:39: TEST_profile_builtin_to_custom: local dir=td/mclock-config 2026-02-17T12:20:19.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:41: TEST_profile_builtin_to_custom: run_mon td/mclock-config a 2026-02-17T12:20:19.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/mclock-config 2026-02-17T12:20:19.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:20:19.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:20:19.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:20:19.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/mclock-config/a 2026-02-17T12:20:19.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-17T12:20:19.691 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:20:19.691 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:20:19.691 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:20:19.691 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:20:19.691 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.691 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.691 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:19.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:20:19.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:20:19.718 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:20:19.718 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:20:19.718 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:20:19.718 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:20:19.718 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:20:19.718 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:20:19.718 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:20:19.718 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:20:19.718 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:19.718 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.719 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.719 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:20:19.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:20:19.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get fsid 2026-02-17T12:20:19.761 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:20:19.762 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:20:19.762 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:20:19.762 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:20:19.762 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:20:19.762 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:20:19.762 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:20:19.762 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:20:19.763 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:19.764 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.764 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.764 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:20:19.764 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:20:19.764 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get mon_host 2026-02-17T12:20:19.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:42: TEST_profile_builtin_to_custom: run_mgr td/mclock-config x 2026-02-17T12:20:19.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/mclock-config 2026-02-17T12:20:19.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:20:19.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:20:19.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:20:19.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/mclock-config/x 2026-02-17T12:20:19.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:20:19.903 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:20:19.903 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:20:19.903 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:20:19.904 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:20:19.904 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.904 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:19.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:20:19.905 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:20:19.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:43: TEST_profile_builtin_to_custom: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-17T12:20:19.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/mclock-config 2026-02-17T12:20:19.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:20:19.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:20:19.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:20:19.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/mclock-config/0 2026-02-17T12:20:19.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-17T12:20:19.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:20:19.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:20:19.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:20:19.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-17T12:20:19.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-17T12:20:19.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:20:19.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:20:19.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-17T12:20:19.926 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-17T12:20:19.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-17T12:20:19.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:20:19.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:20:19.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:20:19.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:20:19.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:20:19.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-17T12:20:19.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/mclock-config/0 2026-02-17T12:20:19.928 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:20:19.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c755c942-ad2c-42fa-a438-f4eecf41bc4d 2026-02-17T12:20:19.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 c755c942-ad2c-42fa-a438-f4eecf41bc4d' 2026-02-17T12:20:19.929 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 c755c942-ad2c-42fa-a438-f4eecf41bc4d 2026-02-17T12:20:19.929 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:20:19.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQADXZRpNTazNxAAbVOIbhiDc7rrC+DQyB4V7w== 2026-02-17T12:20:19.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQADXZRpNTazNxAAbVOIbhiDc7rrC+DQyB4V7w=="}' 2026-02-17T12:20:19.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c755c942-ad2c-42fa-a438-f4eecf41bc4d -i td/mclock-config/0/new.json 2026-02-17T12:20:20.038 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:20:20.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/mclock-config/0/new.json 2026-02-17T12:20:20.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQADXZRpNTazNxAAbVOIbhiDc7rrC+DQyB4V7w== --osd-uuid c755c942-ad2c-42fa-a438-f4eecf41bc4d 2026-02-17T12:20:20.063 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:20.062+0000 7f0d841f9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:20.064 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:20.063+0000 7f0d841f9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:20.065 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:20.064+0000 7f0d841f9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:20.066 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:20.064+0000 7f0d841f9780 -1 bdev(0x557d937dbc00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:20:20.066 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:20.064+0000 7f0d841f9780 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-17T12:20:22.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-17T12:20:22.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:20:22.961 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:20:22.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:20:22.962 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:20:23.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:20:23.231 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:20:23.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-17T12:20:23.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:20:23.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:20:23.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:20:23.247 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:23.245+0000 7f18d7e0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:23.248 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:23.247+0000 7f18d7e0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:23.249 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:23.248+0000 7f18d7e0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:23.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:20:23.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:20:23.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:20:23.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:20:23.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:20:23.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:23.416 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:20:23.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:20:23.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:23.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:23.602 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:24.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:24.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:24.604 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:20:24.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:20:24.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:24.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:24.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:24.831 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:24.829+0000 7f18d7e0d780 -1 Falling back to public interface 2026-02-17T12:20:25.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:25.791 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:25.791 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:20:25.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:20:25.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:25.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:25.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:26.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:26.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:26.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:20:26.978 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:20:26.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:26.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:27.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:27.523 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:27.521+0000 7f18d7e0d780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:20:28.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:28.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:28.167 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:20:28.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:20:28.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:28.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:28.357 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/274437544,v1:127.0.0.1:6803/274437544] [v2:127.0.0.1:6804/274437544,v1:127.0.0.1:6805/274437544] exists,up c755c942-ad2c-42fa-a438-f4eecf41bc4d 2026-02-17T12:20:28.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:20:28.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:20:28.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:20:28.358 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:46: TEST_profile_builtin_to_custom: ceph config get osd.0 osd_mclock_profile 2026-02-17T12:20:28.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:46: TEST_profile_builtin_to_custom: local mclock_profile=balanced 2026-02-17T12:20:28.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:47: TEST_profile_builtin_to_custom: test balanced = balanced 2026-02-17T12:20:28.546 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:52: TEST_profile_builtin_to_custom: jq .osd_mclock_profile 2026-02-17T12:20:28.546 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:52: TEST_profile_builtin_to_custom: get_asok_path osd.0 2026-02-17T12:20:28.546 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:28.547 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:28.547 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:28.547 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:28.547 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:28.547 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:28.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:52: TEST_profile_builtin_to_custom: CEPH_ARGS= 2026-02-17T12:20:28.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:52: TEST_profile_builtin_to_custom: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_profile 2026-02-17T12:20:28.594 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:52: TEST_profile_builtin_to_custom: mclock_profile='"high_recovery_ops"' 2026-02-17T12:20:28.594 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:53: TEST_profile_builtin_to_custom: eval echo '"high_recovery_ops"' 2026-02-17T12:20:28.594 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:53: TEST_profile_builtin_to_custom: echo high_recovery_ops 2026-02-17T12:20:28.594 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:53: TEST_profile_builtin_to_custom: mclock_profile=high_recovery_ops 2026-02-17T12:20:28.594 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:54: TEST_profile_builtin_to_custom: test high_recovery_ops = high_recovery_ops 2026-02-17T12:20:28.594 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:57: TEST_profile_builtin_to_custom: ceph tell osd.0 config set osd_mclock_profile custom 2026-02-17T12:20:28.649 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:20:28.649 INFO:tasks.workunit.client.0.trial155.stdout: "success": "" 2026-02-17T12:20:28.649 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:20:28.653 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:61: TEST_profile_builtin_to_custom: jq .osd_mclock_profile 2026-02-17T12:20:28.654 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:61: TEST_profile_builtin_to_custom: get_asok_path osd.0 2026-02-17T12:20:28.654 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:28.655 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:28.655 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:28.655 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:28.655 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:28.655 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:28.655 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:61: TEST_profile_builtin_to_custom: CEPH_ARGS= 2026-02-17T12:20:28.656 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:61: TEST_profile_builtin_to_custom: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_profile 2026-02-17T12:20:28.706 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:61: TEST_profile_builtin_to_custom: mclock_profile='"custom"' 2026-02-17T12:20:28.706 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:62: TEST_profile_builtin_to_custom: eval echo '"custom"' 2026-02-17T12:20:28.706 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:62: TEST_profile_builtin_to_custom: echo custom 2026-02-17T12:20:28.706 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:62: TEST_profile_builtin_to_custom: mclock_profile=custom 2026-02-17T12:20:28.706 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:63: TEST_profile_builtin_to_custom: test custom = custom 2026-02-17T12:20:28.708 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: jq .osd_mclock_scheduler_client_res 2026-02-17T12:20:28.708 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: bc 2026-02-17T12:20:28.708 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: get_asok_path osd.0 2026-02-17T12:20:28.708 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:28.708 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:28.708 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:28.708 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:28.708 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:28.709 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:28.709 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: CEPH_ARGS= 2026-02-17T12:20:28.709 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-17T12:20:28.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:68: TEST_profile_builtin_to_custom: local client_res=0.300000 2026-02-17T12:20:28.757 INFO:tasks.workunit.client.0.trial155.stdout:client_res = 0.300000 2026-02-17T12:20:28.758 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:69: TEST_profile_builtin_to_custom: echo 'client_res = 0.300000' 2026-02-17T12:20:28.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:70: TEST_profile_builtin_to_custom: echo '0.300000 + 0.1' 2026-02-17T12:20:28.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:70: TEST_profile_builtin_to_custom: bc -l 2026-02-17T12:20:28.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:70: TEST_profile_builtin_to_custom: local client_res_new=.400000 2026-02-17T12:20:28.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:71: TEST_profile_builtin_to_custom: echo 'client_res_new = .400000' 2026-02-17T12:20:28.759 INFO:tasks.workunit.client.0.trial155.stdout:client_res_new = .400000 2026-02-17T12:20:28.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:72: TEST_profile_builtin_to_custom: ceph config set osd.0 osd_mclock_scheduler_client_res .400000 2026-02-17T12:20:28.954 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:77: TEST_profile_builtin_to_custom: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-17T12:20:29.148 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:77: TEST_profile_builtin_to_custom: local res=0.400000 2026-02-17T12:20:29.149 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:78: TEST_profile_builtin_to_custom: echo '0.400000 != .400000' 2026-02-17T12:20:29.149 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:78: TEST_profile_builtin_to_custom: bc -l 2026-02-17T12:20:29.149 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:78: TEST_profile_builtin_to_custom: (( 0 )) 2026-02-17T12:20:29.150 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: jq .osd_mclock_scheduler_client_res 2026-02-17T12:20:29.151 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: bc 2026-02-17T12:20:29.151 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: get_asok_path osd.0 2026-02-17T12:20:29.152 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:29.152 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:29.152 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:29.152 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.152 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.152 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:29.152 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: CEPH_ARGS= 2026-02-17T12:20:29.152 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-17T12:20:29.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:84: TEST_profile_builtin_to_custom: res=0.400000 2026-02-17T12:20:29.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:85: TEST_profile_builtin_to_custom: echo '0.400000 != .400000' 2026-02-17T12:20:29.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:85: TEST_profile_builtin_to_custom: bc -l 2026-02-17T12:20:29.202 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:85: TEST_profile_builtin_to_custom: (( 0 )) 2026-02-17T12:20:29.202 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:89: TEST_profile_builtin_to_custom: teardown td/mclock-config 2026-02-17T12:20:29.203 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:20:29.203 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:20:29.203 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:20:29.203 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:29.203 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:29.203 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:29.203 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:29.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:29.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:29.309 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:20:29.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:20:29.311 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:20:29.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:20:29.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:20:29.312 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:20:29.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:29.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:20:29.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:20:29.314 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:29.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:20:29.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:20:29.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:20:29.319 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:20:29.320 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.320 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:20:29.321 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:20:29.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:20:29.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-17T12:20:29.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:20:29.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:20:29.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:20:29.322 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:29.322 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:29.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:29.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:29.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:29.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:29.323 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:20:29.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:20:29.324 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:20:29.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:20:29.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:20:29.325 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:20:29.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:29.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:20:29.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:20:29.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:29.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:20:29.328 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:20:29.328 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:20:29.329 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:20:29.330 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.330 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:20:29.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:20:29.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/mclock-config 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/mclock-config 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:29.333 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:29.333 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:20:29.333 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:20:29.334 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:20:29.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:20:29.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:20:29.335 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:20:29.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:29.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:20:29.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:20:29.336 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:29.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:20:29.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:20:29.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:20:29.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:20:29.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:20:29.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:20:29.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:20:29.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/mclock-config 2026-02-17T12:20:29.341 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:20:29.341 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.341 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37494 2026-02-17T12:20:29.342 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:20:29.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:20:29.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:20:29.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-17T12:20:29.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_profile_custom_to_builtin td/mclock-config 2026-02-17T12:20:29.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:93: TEST_profile_custom_to_builtin: local dir=td/mclock-config 2026-02-17T12:20:29.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:95: TEST_profile_custom_to_builtin: setup td/mclock-config 2026-02-17T12:20:29.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/mclock-config 2026-02-17T12:20:29.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/mclock-config 2026-02-17T12:20:29.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:20:29.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:20:29.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:20:29.345 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:29.345 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:29.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:29.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:29.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:29.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:29.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:20:29.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:20:29.347 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:20:29.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:20:29.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:20:29.348 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:20:29.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:29.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:20:29.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:20:29.349 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:29.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:20:29.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:20:29.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:20:29.352 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:20:29.352 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.352 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:20:29.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:20:29.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:20:29.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/mclock-config 2026-02-17T12:20:29.354 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:20:29.354 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.354 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37494 2026-02-17T12:20:29.355 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:20:29.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:20:29.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:20:29.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-17T12:20:29.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:96: TEST_profile_custom_to_builtin: run_mon td/mclock-config a 2026-02-17T12:20:29.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/mclock-config 2026-02-17T12:20:29.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:20:29.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:20:29.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:20:29.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/mclock-config/a 2026-02-17T12:20:29.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-17T12:20:29.374 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:20:29.374 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:20:29.375 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:20:29.375 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:20:29.375 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.375 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.375 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:29.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:20:29.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:20:29.401 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:20:29.401 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:20:29.401 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:20:29.401 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:20:29.401 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:20:29.402 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:20:29.402 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:20:29.402 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:20:29.403 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:29.403 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.403 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.403 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:20:29.403 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:20:29.403 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get fsid 2026-02-17T12:20:29.449 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:20:29.449 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:20:29.449 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:20:29.449 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:20:29.450 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:20:29.450 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:20:29.450 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:20:29.450 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:20:29.451 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:29.451 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.451 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.451 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:20:29.451 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:20:29.451 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get mon_host 2026-02-17T12:20:29.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:97: TEST_profile_custom_to_builtin: run_mgr td/mclock-config x 2026-02-17T12:20:29.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/mclock-config 2026-02-17T12:20:29.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:20:29.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:20:29.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:20:29.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/mclock-config/x 2026-02-17T12:20:29.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:20:29.594 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:20:29.594 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:20:29.594 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:20:29.594 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:20:29.594 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.594 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.595 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:29.595 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:20:29.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:20:29.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:98: TEST_profile_custom_to_builtin: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-17T12:20:29.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/mclock-config 2026-02-17T12:20:29.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:20:29.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:20:29.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:20:29.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/mclock-config/0 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:29.613 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/mclock-config/0 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:20:29.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e6c1d4c0-4fae-4a7b-9b58-7c98def4a926 2026-02-17T12:20:29.615 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 e6c1d4c0-4fae-4a7b-9b58-7c98def4a926 2026-02-17T12:20:29.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 e6c1d4c0-4fae-4a7b-9b58-7c98def4a926' 2026-02-17T12:20:29.615 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:20:29.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQANXZRp5rBBJRAAOzx7mxoELXWQsPue1UmrKQ== 2026-02-17T12:20:29.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQANXZRp5rBBJRAAOzx7mxoELXWQsPue1UmrKQ=="}' 2026-02-17T12:20:29.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e6c1d4c0-4fae-4a7b-9b58-7c98def4a926 -i td/mclock-config/0/new.json 2026-02-17T12:20:29.727 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:20:29.733 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/mclock-config/0/new.json 2026-02-17T12:20:29.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQANXZRp5rBBJRAAOzx7mxoELXWQsPue1UmrKQ== --osd-uuid e6c1d4c0-4fae-4a7b-9b58-7c98def4a926 2026-02-17T12:20:29.751 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:29.750+0000 7fd42e218780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:29.753 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:29.751+0000 7fd42e218780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:29.753 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:29.752+0000 7fd42e218780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:29.754 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:29.752+0000 7fd42e218780 -1 bdev(0x55bfdac77c00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:20:29.754 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:29.752+0000 7fd42e218780 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-17T12:20:32.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-17T12:20:32.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:20:32.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:20:32.651 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:20:32.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:20:32.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:20:32.911 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:20:32.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-17T12:20:32.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:20:32.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:20:32.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:20:32.927 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:32.926+0000 7f3132411780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:32.929 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:32.927+0000 7f3132411780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:32.929 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:32.928+0000 7f3132411780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:33.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:20:33.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:20:33.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:20:33.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:20:33.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:20:33.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:33.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:20:33.100 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:20:33.100 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:33.100 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:33.287 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:34.288 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:34.289 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:34.289 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:20:34.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:20:34.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:34.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:34.474 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:34.524 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:34.522+0000 7f3132411780 -1 Falling back to public interface 2026-02-17T12:20:35.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:35.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:35.475 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:20:35.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:20:35.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:35.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:35.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:36.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:36.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:36.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:20:36.663 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:20:36.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:36.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:36.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:37.455 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:37.453+0000 7f3132411780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:20:37.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:37.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:37.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:20:37.851 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:20:37.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:37.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:38.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:39.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:39.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:39.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:20:39.047 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:20:39.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:39.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:39.236 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2442736647,v1:127.0.0.1:6803/2442736647] [v2:127.0.0.1:6804/2442736647,v1:127.0.0.1:6805/2442736647] exists,up e6c1d4c0-4fae-4a7b-9b58-7c98def4a926 2026-02-17T12:20:39.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:20:39.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:20:39.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:20:39.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:101: TEST_profile_custom_to_builtin: local def_mclock_profile 2026-02-17T12:20:39.237 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:102: TEST_profile_custom_to_builtin: ceph config get osd.0 osd_mclock_profile 2026-02-17T12:20:39.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:102: TEST_profile_custom_to_builtin: def_mclock_profile=balanced 2026-02-17T12:20:39.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:103: TEST_profile_custom_to_builtin: test balanced = balanced 2026-02-17T12:20:39.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:108: TEST_profile_custom_to_builtin: jq .osd_mclock_profile 2026-02-17T12:20:39.431 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:108: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-17T12:20:39.431 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:39.432 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:39.432 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:39.432 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:39.432 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:39.432 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:39.432 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:108: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-17T12:20:39.432 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:108: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_profile 2026-02-17T12:20:39.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:108: TEST_profile_custom_to_builtin: local 'orig_mclock_profile="high_recovery_ops"' 2026-02-17T12:20:39.478 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:109: TEST_profile_custom_to_builtin: eval echo '"high_recovery_ops"' 2026-02-17T12:20:39.478 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:109: TEST_profile_custom_to_builtin: echo high_recovery_ops 2026-02-17T12:20:39.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:109: TEST_profile_custom_to_builtin: orig_mclock_profile=high_recovery_ops 2026-02-17T12:20:39.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:110: TEST_profile_custom_to_builtin: test high_recovery_ops = high_recovery_ops 2026-02-17T12:20:39.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:113: TEST_profile_custom_to_builtin: ceph tell osd.0 config set osd_mclock_profile custom 2026-02-17T12:20:39.532 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:20:39.532 INFO:tasks.workunit.client.0.trial155.stdout: "success": "" 2026-02-17T12:20:39.532 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:20:39.536 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:118: TEST_profile_custom_to_builtin: jq .osd_mclock_profile 2026-02-17T12:20:39.537 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:118: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-17T12:20:39.538 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:39.538 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:39.538 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:39.538 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:39.538 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:39.538 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:39.538 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:118: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-17T12:20:39.538 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:118: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_profile 2026-02-17T12:20:39.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:118: TEST_profile_custom_to_builtin: local 'mclock_profile="custom"' 2026-02-17T12:20:39.587 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:119: TEST_profile_custom_to_builtin: eval echo '"custom"' 2026-02-17T12:20:39.587 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:119: TEST_profile_custom_to_builtin: echo custom 2026-02-17T12:20:39.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:119: TEST_profile_custom_to_builtin: mclock_profile=custom 2026-02-17T12:20:39.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:120: TEST_profile_custom_to_builtin: test custom = custom 2026-02-17T12:20:39.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:123: TEST_profile_custom_to_builtin: local client_res 2026-02-17T12:20:39.589 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: jq .osd_mclock_scheduler_client_res 2026-02-17T12:20:39.589 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: bc 2026-02-17T12:20:39.590 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-17T12:20:39.590 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:39.590 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:39.590 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:39.590 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:39.590 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:39.590 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:39.590 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-17T12:20:39.590 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-17T12:20:39.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:126: TEST_profile_custom_to_builtin: client_res=0.300000 2026-02-17T12:20:39.637 INFO:tasks.workunit.client.0.trial155.stdout:Original client_res for osd.0 = 0.300000 2026-02-17T12:20:39.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:127: TEST_profile_custom_to_builtin: echo 'Original client_res for osd.0 = 0.300000' 2026-02-17T12:20:39.637 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:130: TEST_profile_custom_to_builtin: echo '0.300000 + 0.1' 2026-02-17T12:20:39.638 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:130: TEST_profile_custom_to_builtin: bc -l 2026-02-17T12:20:39.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:130: TEST_profile_custom_to_builtin: local client_res_new=.400000 2026-02-17T12:20:39.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:131: TEST_profile_custom_to_builtin: echo 'client_res_new = .400000' 2026-02-17T12:20:39.639 INFO:tasks.workunit.client.0.trial155.stdout:client_res_new = .400000 2026-02-17T12:20:39.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:132: TEST_profile_custom_to_builtin: ceph config set osd osd_mclock_scheduler_client_res .400000 2026-02-17T12:20:39.830 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:136: TEST_profile_custom_to_builtin: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-17T12:20:40.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:136: TEST_profile_custom_to_builtin: local res=0.400000 2026-02-17T12:20:40.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:137: TEST_profile_custom_to_builtin: echo '0.400000 != .400000' 2026-02-17T12:20:40.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:137: TEST_profile_custom_to_builtin: bc -l 2026-02-17T12:20:40.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:137: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-17T12:20:40.026 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: jq .osd_mclock_scheduler_client_res 2026-02-17T12:20:40.026 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: bc 2026-02-17T12:20:40.026 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-17T12:20:40.026 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:40.026 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:40.027 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:40.027 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:40.027 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:40.027 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:40.027 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-17T12:20:40.027 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-17T12:20:40.074 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:143: TEST_profile_custom_to_builtin: res=0.400000 2026-02-17T12:20:40.075 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:144: TEST_profile_custom_to_builtin: echo '0.400000 != .400000' 2026-02-17T12:20:40.075 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:144: TEST_profile_custom_to_builtin: bc -l 2026-02-17T12:20:40.076 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:144: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-17T12:20:40.076 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:154: TEST_profile_custom_to_builtin: ceph tell osd.0 config set osd_mclock_profile high_recovery_ops 2026-02-17T12:20:40.133 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:20:40.133 INFO:tasks.workunit.client.0.trial155.stdout: "success": "" 2026-02-17T12:20:40.133 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:20:40.139 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: jq .osd_mclock_profile 2026-02-17T12:20:40.140 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-17T12:20:40.140 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:40.140 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:40.140 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:40.140 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:40.140 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:40.140 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:40.140 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-17T12:20:40.140 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_profile 2026-02-17T12:20:40.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: eval 'mclock_profile="high_recovery_ops"' 2026-02-17T12:20:40.186 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:158: TEST_profile_custom_to_builtin: mclock_profile=high_recovery_ops 2026-02-17T12:20:40.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:160: TEST_profile_custom_to_builtin: test high_recovery_ops = high_recovery_ops 2026-02-17T12:20:40.187 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:165: TEST_profile_custom_to_builtin: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-17T12:20:40.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:165: TEST_profile_custom_to_builtin: local res=0.400000 2026-02-17T12:20:40.373 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:166: TEST_profile_custom_to_builtin: echo '0.400000 != .400000' 2026-02-17T12:20:40.373 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:166: TEST_profile_custom_to_builtin: bc -l 2026-02-17T12:20:40.374 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:166: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-17T12:20:40.375 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: jq .osd_mclock_scheduler_client_res 2026-02-17T12:20:40.375 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: bc 2026-02-17T12:20:40.376 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-17T12:20:40.376 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:40.376 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:40.376 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:40.376 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:40.376 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:40.376 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:40.376 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-17T12:20:40.376 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-17T12:20:40.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:172: TEST_profile_custom_to_builtin: res=0.400000 2026-02-17T12:20:40.427 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:173: TEST_profile_custom_to_builtin: echo '0.400000 != .400000' 2026-02-17T12:20:40.427 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:173: TEST_profile_custom_to_builtin: bc -l 2026-02-17T12:20:40.428 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:173: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-17T12:20:40.428 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:178: TEST_profile_custom_to_builtin: ceph config rm osd osd_mclock_scheduler_client_res 2026-02-17T12:20:40.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:180: TEST_profile_custom_to_builtin: sleep 5 2026-02-17T12:20:45.615 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:185: TEST_profile_custom_to_builtin: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-17T12:20:45.803 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:185: TEST_profile_custom_to_builtin: res=0.000000 2026-02-17T12:20:45.804 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:186: TEST_profile_custom_to_builtin: echo '0.000000 != 0.0' 2026-02-17T12:20:45.804 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:186: TEST_profile_custom_to_builtin: bc -l 2026-02-17T12:20:45.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:186: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-17T12:20:45.806 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: jq .osd_mclock_scheduler_client_res 2026-02-17T12:20:45.806 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: bc 2026-02-17T12:20:45.806 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: get_asok_path osd.0 2026-02-17T12:20:45.806 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:45.806 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:45.806 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:45.806 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:45.806 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:45.806 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:45.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: CEPH_ARGS= 2026-02-17T12:20:45.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-17T12:20:45.854 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:193: TEST_profile_custom_to_builtin: res=0.300000 2026-02-17T12:20:45.854 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:194: TEST_profile_custom_to_builtin: echo '0.300000 != 0.300000' 2026-02-17T12:20:45.855 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:194: TEST_profile_custom_to_builtin: bc -l 2026-02-17T12:20:45.856 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:194: TEST_profile_custom_to_builtin: (( 0 )) 2026-02-17T12:20:45.856 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:198: TEST_profile_custom_to_builtin: teardown td/mclock-config 2026-02-17T12:20:45.856 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:20:45.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:20:45.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:20:45.857 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:45.857 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:45.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:45.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:45.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:45.962 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:45.963 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:20:45.963 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:20:45.964 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:20:45.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:20:45.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:20:45.965 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:20:45.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:45.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:20:45.967 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:20:45.967 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:45.968 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:20:45.969 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:20:45.969 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:20:45.972 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:20:45.972 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:45.972 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:45.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:20:45.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:20:45.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:20:45.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-17T12:20:45.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:20:45.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:20:45.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:20:45.974 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:45.974 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:45.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:45.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:45.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:45.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:45.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:20:45.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:20:45.977 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:20:45.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:20:45.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:20:45.978 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:20:45.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:45.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:20:45.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:20:45.979 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:45.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:20:45.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:20:45.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:20:45.982 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:20:45.982 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:45.982 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:45.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:20:45.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:20:45.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:20:45.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-17T12:20:45.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-17T12:20:45.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/mclock-config 2026-02-17T12:20:45.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/mclock-config 2026-02-17T12:20:45.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:20:45.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:20:45.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:20:45.984 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:45.984 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:45.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:45.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:45.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:45.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:45.985 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:20:45.986 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:20:45.986 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:20:45.987 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:20:45.987 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:20:45.987 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:20:45.988 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:45.988 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:20:45.989 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:20:45.989 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:45.990 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:20:45.990 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:20:45.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:20:45.992 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:20:45.992 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:45.992 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:45.992 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:20:45.993 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:20:45.993 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:20:45.993 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/mclock-config 2026-02-17T12:20:45.994 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:20:45.994 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:45.994 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:45.994 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37494 2026-02-17T12:20:45.995 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:20:45.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:20:45.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:20:45.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-17T12:20:45.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_profile_disallow_builtin_params_modify td/mclock-config 2026-02-17T12:20:45.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:305: TEST_profile_disallow_builtin_params_modify: local dir=td/mclock-config 2026-02-17T12:20:45.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:307: TEST_profile_disallow_builtin_params_modify: setup td/mclock-config 2026-02-17T12:20:45.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/mclock-config 2026-02-17T12:20:45.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/mclock-config 2026-02-17T12:20:45.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:20:45.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:20:45.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:20:45.998 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:20:45.998 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:20:45.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:20:45.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:20:45.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:20:45.999 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:20:45.999 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:20:45.999 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:20:45.999 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:20:46.000 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:20:46.000 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:20:46.000 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:20:46.001 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:46.001 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:20:46.002 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:20:46.002 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:20:46.002 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:20:46.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:20:46.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:20:46.004 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:20:46.005 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:46.005 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:46.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:20:46.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:20:46.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:20:46.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/mclock-config 2026-02-17T12:20:46.007 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:20:46.007 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:46.007 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:46.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37494 2026-02-17T12:20:46.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:20:46.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:20:46.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:20:46.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-17T12:20:46.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:308: TEST_profile_disallow_builtin_params_modify: run_mon td/mclock-config a 2026-02-17T12:20:46.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/mclock-config 2026-02-17T12:20:46.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:20:46.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:20:46.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:20:46.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/mclock-config/a 2026-02-17T12:20:46.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-17T12:20:46.027 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:20:46.027 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:20:46.027 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:20:46.027 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:20:46.027 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:46.027 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:46.027 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:46.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:20:46.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:20:46.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:20:46.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:20:46.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:20:46.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:20:46.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:20:46.055 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:20:46.055 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:20:46.056 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:20:46.056 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:46.056 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:46.056 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:46.056 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:20:46.057 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:20:46.057 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get fsid 2026-02-17T12:20:46.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:20:46.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:20:46.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:20:46.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:20:46.100 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:20:46.101 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:20:46.101 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:20:46.101 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:20:46.101 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:46.101 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:46.101 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:46.101 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:20:46.101 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:20:46.101 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get mon_host 2026-02-17T12:20:46.146 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:309: TEST_profile_disallow_builtin_params_modify: run_mgr td/mclock-config x 2026-02-17T12:20:46.146 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/mclock-config 2026-02-17T12:20:46.146 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:20:46.146 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:20:46.146 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:20:46.146 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/mclock-config/x 2026-02-17T12:20:46.146 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:20:46.247 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:20:46.247 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:20:46.247 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:20:46.247 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:20:46.247 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:46.247 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:46.248 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:46.248 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:20:46.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:20:46.267 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:311: TEST_profile_disallow_builtin_params_modify: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-17T12:20:46.267 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/mclock-config 2026-02-17T12:20:46.267 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:20:46.267 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:20:46.267 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:20:46.267 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/mclock-config/0 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:20:46.268 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:20:46.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:20:46.270 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:20:46.270 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:20:46.270 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-17T12:20:46.270 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/mclock-config/0 2026-02-17T12:20:46.270 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:20:46.270 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e0b4000e-7581-446a-b9da-5c53debc8fd8 2026-02-17T12:20:46.271 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 e0b4000e-7581-446a-b9da-5c53debc8fd8' 2026-02-17T12:20:46.271 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 e0b4000e-7581-446a-b9da-5c53debc8fd8 2026-02-17T12:20:46.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:20:46.279 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAeXZRpe/mEEBAA1V5sFbeynHn0M42xqbSMwQ== 2026-02-17T12:20:46.279 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAeXZRpe/mEEBAA1V5sFbeynHn0M42xqbSMwQ=="}' 2026-02-17T12:20:46.279 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e0b4000e-7581-446a-b9da-5c53debc8fd8 -i td/mclock-config/0/new.json 2026-02-17T12:20:46.382 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:20:46.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/mclock-config/0/new.json 2026-02-17T12:20:46.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQAeXZRpe/mEEBAA1V5sFbeynHn0M42xqbSMwQ== --osd-uuid e0b4000e-7581-446a-b9da-5c53debc8fd8 2026-02-17T12:20:46.406 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:46.403+0000 7f8a5920d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:46.408 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:46.405+0000 7f8a5920d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:46.408 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:46.406+0000 7f8a5920d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:46.409 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:46.406+0000 7f8a5920d780 -1 bdev(0x55fb4738bc00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:20:46.409 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:46.406+0000 7f8a5920d780 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-17T12:20:49.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-17T12:20:49.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:20:49.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:20:49.297 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:20:49.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:20:49.549 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:20:49.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:20:49.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-17T12:20:49.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:20:49.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:20:49.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:20:49.567 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:49.564+0000 7fcb84bb4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:49.568 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:49.566+0000 7fcb84bb4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:49.569 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:49.567+0000 7fcb84bb4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:20:49.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:20:49.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:20:49.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:20:49.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:20:49.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:20:49.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:49.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:20:49.736 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:20:49.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:49.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:49.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:50.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:50.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:50.924 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:20:50.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:20:50.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:50.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:51.114 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:51.164 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:51.162+0000 7fcb84bb4780 -1 Falling back to public interface 2026-02-17T12:20:52.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:52.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:52.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:20:52.115 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:20:52.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:52.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:52.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:53.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:53.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:53.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:20:53.304 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:20:53.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:53.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:53.493 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:54.097 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:20:54.095+0000 7fcb84bb4780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:20:54.494 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:54.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:54.495 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:20:54.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:20:54.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:54.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:54.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:20:55.686 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:20:55.686 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:20:55.687 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:20:55.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:20:55.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:20:55.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:20:55.873 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1008468549,v1:127.0.0.1:6803/1008468549] [v2:127.0.0.1:6804/1008468549,v1:127.0.0.1:6805/1008468549] exists,up e0b4000e-7581-446a-b9da-5c53debc8fd8 2026-02-17T12:20:55.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:20:55.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:20:55.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:20:55.874 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:314: TEST_profile_disallow_builtin_params_modify: ceph config get osd.0 osd_mclock_profile 2026-02-17T12:20:56.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:314: TEST_profile_disallow_builtin_params_modify: local def_mclock_profile=balanced 2026-02-17T12:20:56.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:315: TEST_profile_disallow_builtin_params_modify: test balanced = balanced 2026-02-17T12:20:56.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:320: TEST_profile_disallow_builtin_params_modify: jq .osd_mclock_profile 2026-02-17T12:20:56.065 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:320: TEST_profile_disallow_builtin_params_modify: get_asok_path osd.0 2026-02-17T12:20:56.065 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:56.066 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:56.066 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:56.066 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:56.066 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:56.066 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:56.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:320: TEST_profile_disallow_builtin_params_modify: CEPH_ARGS= 2026-02-17T12:20:56.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:320: TEST_profile_disallow_builtin_params_modify: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_profile 2026-02-17T12:20:56.114 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:320: TEST_profile_disallow_builtin_params_modify: local 'cur_mclock_profile="high_recovery_ops"' 2026-02-17T12:20:56.116 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:321: TEST_profile_disallow_builtin_params_modify: eval echo '"high_recovery_ops"' 2026-02-17T12:20:56.117 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:321: TEST_profile_disallow_builtin_params_modify: echo high_recovery_ops 2026-02-17T12:20:56.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:321: TEST_profile_disallow_builtin_params_modify: cur_mclock_profile=high_recovery_ops 2026-02-17T12:20:56.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:322: TEST_profile_disallow_builtin_params_modify: test high_recovery_ops = high_recovery_ops 2026-02-17T12:20:56.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:324: TEST_profile_disallow_builtin_params_modify: options=('osd_mclock_scheduler_background_recovery_res' 'osd_mclock_scheduler_client_res') 2026-02-17T12:20:56.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:324: TEST_profile_disallow_builtin_params_modify: declare -a options 2026-02-17T12:20:56.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:327: TEST_profile_disallow_builtin_params_modify: local retries=10 2026-02-17T12:20:56.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:328: TEST_profile_disallow_builtin_params_modify: local errors=0 2026-02-17T12:20:56.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:329: TEST_profile_disallow_builtin_params_modify: for opt in "${options[@]}" 2026-02-17T12:20:56.117 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: jq .osd_mclock_scheduler_background_recovery_res 2026-02-17T12:20:56.117 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: bc 2026-02-17T12:20:56.118 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: get_asok_path osd.0 2026-02-17T12:20:56.118 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:56.118 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:56.118 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:56.118 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:56.118 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:56.118 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:56.118 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: CEPH_ARGS= 2026-02-17T12:20:56.118 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_background_recovery_res 2026-02-17T12:20:56.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: local opt_val_orig=0.700000 2026-02-17T12:20:56.164 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: echo '0.700000 + 0.1' 2026-02-17T12:20:56.164 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:20:56.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: local opt_val_new=.800000 2026-02-17T12:20:56.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:335: TEST_profile_disallow_builtin_params_modify: ceph config set osd.0 osd_mclock_scheduler_background_recovery_res .800000 2026-02-17T12:20:56.355 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: expr 10 - 1 2026-02-17T12:20:56.356 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: seq 0 9 2026-02-17T12:20:56.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: for count in $(seq 0 $(expr $retries - 1)) 2026-02-17T12:20:56.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:340: TEST_profile_disallow_builtin_params_modify: errors=0 2026-02-17T12:20:56.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:341: TEST_profile_disallow_builtin_params_modify: sleep 2 2026-02-17T12:20:58.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:343: TEST_profile_disallow_builtin_params_modify: echo 'Check configuration values - Attempt#: 0' 2026-02-17T12:20:58.358 INFO:tasks.workunit.client.0.trial155.stdout:Check configuration values - Attempt#: 0 2026-02-17T12:20:58.359 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:345: TEST_profile_disallow_builtin_params_modify: ceph config get osd.0 osd_mclock_scheduler_background_recovery_res 2026-02-17T12:20:58.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:345: TEST_profile_disallow_builtin_params_modify: local res=0.000000 2026-02-17T12:20:58.544 INFO:tasks.workunit.client.0.trial155.stdout:Mon db (or default): osd.0 osd_mclock_scheduler_background_recovery_res = 0.000000 2026-02-17T12:20:58.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:346: TEST_profile_disallow_builtin_params_modify: echo 'Mon db (or default): osd.0 osd_mclock_scheduler_background_recovery_res = 0.000000' 2026-02-17T12:20:58.545 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: echo '0.000000 == .800000' 2026-02-17T12:20:58.545 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:20:58.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: (( 0 )) 2026-02-17T12:20:58.546 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: ceph config show osd.0 2026-02-17T12:20:58.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: grep osd_mclock_scheduler_background_recovery_res 2026-02-17T12:20:58.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: awk '{ print $2 }' 2026-02-17T12:20:58.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: bc 2026-02-17T12:20:58.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: res=.700000 2026-02-17T12:20:58.738 INFO:tasks.workunit.client.0.trial155.stdout:Running config: osd.0 osd_mclock_scheduler_background_recovery_res = .700000 2026-02-17T12:20:58.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:354: TEST_profile_disallow_builtin_params_modify: echo 'Running config: osd.0 osd_mclock_scheduler_background_recovery_res = .700000' 2026-02-17T12:20:58.739 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: echo '.700000 == .800000' 2026-02-17T12:20:58.739 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:20:58.739 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: echo '.700000 != 0.700000' 2026-02-17T12:20:58.740 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:20:58.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: (( 0 || 0 )) 2026-02-17T12:20:58.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: jq .osd_mclock_scheduler_background_recovery_res 2026-02-17T12:20:58.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: bc 2026-02-17T12:20:58.742 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: get_asok_path osd.0 2026-02-17T12:20:58.742 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:58.742 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:58.743 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:58.743 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:58.743 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:58.743 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:58.743 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: CEPH_ARGS= 2026-02-17T12:20:58.744 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_background_recovery_res 2026-02-17T12:20:58.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: res=0.700000 2026-02-17T12:20:58.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:363: TEST_profile_disallow_builtin_params_modify: echo 'Values map: osd.0 osd_mclock_scheduler_background_recovery_res = 0.700000' 2026-02-17T12:20:58.789 INFO:tasks.workunit.client.0.trial155.stdout:Values map: osd.0 osd_mclock_scheduler_background_recovery_res = 0.700000 2026-02-17T12:20:58.790 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: echo '0.700000 == .800000' 2026-02-17T12:20:58.790 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:20:58.791 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: echo '0.700000 != 0.700000' 2026-02-17T12:20:58.791 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:20:58.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: (( 0 || 0 )) 2026-02-17T12:20:58.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:370: TEST_profile_disallow_builtin_params_modify: '[' 0 -eq 0 ']' 2026-02-17T12:20:58.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:372: TEST_profile_disallow_builtin_params_modify: break 2026-02-17T12:20:58.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:329: TEST_profile_disallow_builtin_params_modify: for opt in "${options[@]}" 2026-02-17T12:20:58.794 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: jq .osd_mclock_scheduler_client_res 2026-02-17T12:20:58.794 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: bc 2026-02-17T12:20:58.794 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: get_asok_path osd.0 2026-02-17T12:20:58.794 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:20:58.794 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:20:58.794 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:20:58.794 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:20:58.794 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:20:58.795 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:20:58.795 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: CEPH_ARGS= 2026-02-17T12:20:58.795 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-17T12:20:58.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:333: TEST_profile_disallow_builtin_params_modify: local opt_val_orig=0.300000 2026-02-17T12:20:58.843 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: echo '0.300000 + 0.1' 2026-02-17T12:20:58.843 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:20:58.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:334: TEST_profile_disallow_builtin_params_modify: local opt_val_new=.400000 2026-02-17T12:20:58.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:335: TEST_profile_disallow_builtin_params_modify: ceph config set osd.0 osd_mclock_scheduler_client_res .400000 2026-02-17T12:20:59.040 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: expr 10 - 1 2026-02-17T12:20:59.041 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: seq 0 9 2026-02-17T12:20:59.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:338: TEST_profile_disallow_builtin_params_modify: for count in $(seq 0 $(expr $retries - 1)) 2026-02-17T12:20:59.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:340: TEST_profile_disallow_builtin_params_modify: errors=0 2026-02-17T12:20:59.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:341: TEST_profile_disallow_builtin_params_modify: sleep 2 2026-02-17T12:21:01.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:343: TEST_profile_disallow_builtin_params_modify: echo 'Check configuration values - Attempt#: 0' 2026-02-17T12:21:01.043 INFO:tasks.workunit.client.0.trial155.stdout:Check configuration values - Attempt#: 0 2026-02-17T12:21:01.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:345: TEST_profile_disallow_builtin_params_modify: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-17T12:21:01.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:345: TEST_profile_disallow_builtin_params_modify: local res=0.000000 2026-02-17T12:21:01.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:346: TEST_profile_disallow_builtin_params_modify: echo 'Mon db (or default): osd.0 osd_mclock_scheduler_client_res = 0.000000' 2026-02-17T12:21:01.235 INFO:tasks.workunit.client.0.trial155.stdout:Mon db (or default): osd.0 osd_mclock_scheduler_client_res = 0.000000 2026-02-17T12:21:01.236 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: echo '0.000000 == .400000' 2026-02-17T12:21:01.236 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:21:01.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:347: TEST_profile_disallow_builtin_params_modify: (( 0 )) 2026-02-17T12:21:01.237 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: ceph config show osd.0 2026-02-17T12:21:01.237 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: grep osd_mclock_scheduler_client_res 2026-02-17T12:21:01.237 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: awk '{ print $2 }' 2026-02-17T12:21:01.237 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: bc 2026-02-17T12:21:01.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:353: TEST_profile_disallow_builtin_params_modify: res=.300000 2026-02-17T12:21:01.424 INFO:tasks.workunit.client.0.trial155.stdout:Running config: osd.0 osd_mclock_scheduler_client_res = .300000 2026-02-17T12:21:01.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:354: TEST_profile_disallow_builtin_params_modify: echo 'Running config: osd.0 osd_mclock_scheduler_client_res = .300000' 2026-02-17T12:21:01.424 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: echo '.300000 == .400000' 2026-02-17T12:21:01.425 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:21:01.426 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: echo '.300000 != 0.300000' 2026-02-17T12:21:01.426 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:21:01.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:356: TEST_profile_disallow_builtin_params_modify: (( 0 || 0 )) 2026-02-17T12:21:01.428 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: jq .osd_mclock_scheduler_client_res 2026-02-17T12:21:01.428 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: bc 2026-02-17T12:21:01.428 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: get_asok_path osd.0 2026-02-17T12:21:01.428 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:21:01.428 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:21:01.429 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:01.429 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.429 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.429 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:21:01.430 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: CEPH_ARGS= 2026-02-17T12:21:01.430 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-17T12:21:01.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:362: TEST_profile_disallow_builtin_params_modify: res=0.300000 2026-02-17T12:21:01.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:363: TEST_profile_disallow_builtin_params_modify: echo 'Values map: osd.0 osd_mclock_scheduler_client_res = 0.300000' 2026-02-17T12:21:01.476 INFO:tasks.workunit.client.0.trial155.stdout:Values map: osd.0 osd_mclock_scheduler_client_res = 0.300000 2026-02-17T12:21:01.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: echo '0.300000 == .400000' 2026-02-17T12:21:01.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:21:01.478 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: echo '0.300000 != 0.300000' 2026-02-17T12:21:01.478 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: bc -l 2026-02-17T12:21:01.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:365: TEST_profile_disallow_builtin_params_modify: (( 0 || 0 )) 2026-02-17T12:21:01.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:370: TEST_profile_disallow_builtin_params_modify: '[' 0 -eq 0 ']' 2026-02-17T12:21:01.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:372: TEST_profile_disallow_builtin_params_modify: break 2026-02-17T12:21:01.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:380: TEST_profile_disallow_builtin_params_modify: teardown td/mclock-config 2026-02-17T12:21:01.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:21:01.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:21:01.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:21:01.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:01.481 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:01.481 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:01.481 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:01.481 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:01.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:01.586 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:01.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:01.587 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:01.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:01.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:01.589 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:01.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:01.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:01.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:01.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:01.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:01.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:21:01.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:21:01.596 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:01.596 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.596 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:21:01.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:01.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:01.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-17T12:21:01.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:21:01.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:21:01.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:21:01.598 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:01.598 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:01.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:01.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:01.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:01.599 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:01.600 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:01.600 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:01.601 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:01.601 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:01.601 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:01.602 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:01.602 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:01.602 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:01.603 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:01.603 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:01.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:01.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:21:01.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:21:01.606 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:01.606 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.606 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:21:01.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:01.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:01.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-17T12:21:01.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-17T12:21:01.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/mclock-config 2026-02-17T12:21:01.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/mclock-config 2026-02-17T12:21:01.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:21:01.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:21:01.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:21:01.608 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:01.608 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:01.609 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:01.609 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:01.609 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:01.609 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:01.609 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:01.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:01.610 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:01.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:01.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:01.612 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:01.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:01.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:01.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:01.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:01.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:01.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:21:01.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:21:01.615 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:01.616 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.616 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:21:01.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:01.617 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:01.617 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/mclock-config 2026-02-17T12:21:01.618 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:21:01.618 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.618 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.618 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37494 2026-02-17T12:21:01.619 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:21:01.620 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:21:01.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:21:01.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-17T12:21:01.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_profile_disallow_builtin_params_override td/mclock-config 2026-02-17T12:21:01.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:384: TEST_profile_disallow_builtin_params_override: local dir=td/mclock-config 2026-02-17T12:21:01.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:386: TEST_profile_disallow_builtin_params_override: setup td/mclock-config 2026-02-17T12:21:01.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/mclock-config 2026-02-17T12:21:01.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/mclock-config 2026-02-17T12:21:01.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:21:01.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:21:01.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:21:01.622 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:01.622 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:01.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:01.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:01.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:01.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:01.623 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:01.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:01.623 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:01.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:01.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:01.624 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:01.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:01.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:01.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:01.625 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:01.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:01.627 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:21:01.627 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:21:01.628 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:01.628 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.628 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:21:01.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:01.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:01.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/mclock-config 2026-02-17T12:21:01.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:21:01.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37494 2026-02-17T12:21:01.631 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:21:01.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:21:01.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:21:01.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-17T12:21:01.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:387: TEST_profile_disallow_builtin_params_override: run_mon td/mclock-config a 2026-02-17T12:21:01.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/mclock-config 2026-02-17T12:21:01.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:21:01.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:21:01.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:21:01.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/mclock-config/a 2026-02-17T12:21:01.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-17T12:21:01.652 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:21:01.652 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:21:01.652 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:21:01.652 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:21:01.652 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.652 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.652 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:21:01.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:21:01.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:21:01.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:21:01.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:21:01.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:21:01.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:21:01.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:21:01.680 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:21:01.680 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:21:01.680 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:21:01.680 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:01.680 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.680 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.680 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:21:01.680 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:21:01.680 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get fsid 2026-02-17T12:21:01.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:21:01.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:21:01.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:21:01.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:21:01.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:21:01.725 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:21:01.725 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:21:01.725 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:21:01.725 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:01.725 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.725 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.725 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:21:01.725 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:21:01.725 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get mon_host 2026-02-17T12:21:01.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:388: TEST_profile_disallow_builtin_params_override: run_mgr td/mclock-config x 2026-02-17T12:21:01.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/mclock-config 2026-02-17T12:21:01.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:21:01.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:21:01.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:21:01.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/mclock-config/x 2026-02-17T12:21:01.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:21:01.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:21:01.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:21:01.867 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:21:01.867 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:21:01.867 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.867 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.867 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:21:01.868 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:21:01.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:21:01.886 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:390: TEST_profile_disallow_builtin_params_override: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-17T12:21:01.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/mclock-config 2026-02-17T12:21:01.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:21:01.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:21:01.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:21:01.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/mclock-config/0 2026-02-17T12:21:01.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-17T12:21:01.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:21:01.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:21:01.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:21:01.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-17T12:21:01.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:21:01.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/mclock-config/0 2026-02-17T12:21:01.889 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:21:01.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=9e52efe5-79bd-4408-b177-fc1567a9f372 2026-02-17T12:21:01.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 9e52efe5-79bd-4408-b177-fc1567a9f372' 2026-02-17T12:21:01.890 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 9e52efe5-79bd-4408-b177-fc1567a9f372 2026-02-17T12:21:01.891 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:21:01.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAtXZRpqjF5NRAApO2scFbEE59YRqblQOBGPg== 2026-02-17T12:21:01.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAtXZRpqjF5NRAApO2scFbEE59YRqblQOBGPg=="}' 2026-02-17T12:21:01.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 9e52efe5-79bd-4408-b177-fc1567a9f372 -i td/mclock-config/0/new.json 2026-02-17T12:21:01.999 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:21:02.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/mclock-config/0/new.json 2026-02-17T12:21:02.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQAtXZRpqjF5NRAApO2scFbEE59YRqblQOBGPg== --osd-uuid 9e52efe5-79bd-4408-b177-fc1567a9f372 2026-02-17T12:21:02.025 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:02.024+0000 7f9d9aa18780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:02.026 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:02.025+0000 7f9d9aa18780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:02.027 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:02.026+0000 7f9d9aa18780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:02.027 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:02.026+0000 7f9d9aa18780 -1 bdev(0x55f555e3fc00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:21:02.028 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:02.026+0000 7f9d9aa18780 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-17T12:21:04.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-17T12:21:04.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:21:04.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:21:04.912 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:21:04.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:21:05.165 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:21:05.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:21:05.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-17T12:21:05.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:21:05.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:21:05.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:21:05.181 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:05.180+0000 7f047c751780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:05.183 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:05.181+0000 7f047c751780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:05.184 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:05.182+0000 7f047c751780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:05.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:21:05.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:21:05.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:21:05.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:21:05.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:21:05.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:05.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:21:05.356 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:21:05.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:05.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:05.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:06.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:06.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:06.545 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:21:06.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:21:06.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:06.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:06.731 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:06.767 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:06.766+0000 7f047c751780 -1 Falling back to public interface 2026-02-17T12:21:07.732 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:07.733 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:07.733 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:21:07.733 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:21:07.733 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:07.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:07.919 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:08.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:08.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:08.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:21:08.921 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:21:08.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:08.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:09.106 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:09.709 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:09.708+0000 7f047c751780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:21:10.107 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:10.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:10.108 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:21:10.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:21:10.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:10.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:10.295 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1153069981,v1:127.0.0.1:6803/1153069981] [v2:127.0.0.1:6804/1153069981,v1:127.0.0.1:6805/1153069981] exists,up 9e52efe5-79bd-4408-b177-fc1567a9f372 2026-02-17T12:21:10.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:21:10.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:21:10.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:21:10.296 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:393: TEST_profile_disallow_builtin_params_override: ceph config get osd.0 osd_mclock_profile 2026-02-17T12:21:10.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:393: TEST_profile_disallow_builtin_params_override: local def_mclock_profile=balanced 2026-02-17T12:21:10.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:394: TEST_profile_disallow_builtin_params_override: test balanced = balanced 2026-02-17T12:21:10.491 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:399: TEST_profile_disallow_builtin_params_override: jq .osd_mclock_profile 2026-02-17T12:21:10.491 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:399: TEST_profile_disallow_builtin_params_override: get_asok_path osd.0 2026-02-17T12:21:10.491 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:21:10.491 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:21:10.492 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:10.492 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:10.492 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:10.492 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:21:10.492 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:399: TEST_profile_disallow_builtin_params_override: CEPH_ARGS= 2026-02-17T12:21:10.492 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:399: TEST_profile_disallow_builtin_params_override: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_profile 2026-02-17T12:21:10.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:399: TEST_profile_disallow_builtin_params_override: local 'cur_mclock_profile="high_recovery_ops"' 2026-02-17T12:21:10.541 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:400: TEST_profile_disallow_builtin_params_override: eval echo '"high_recovery_ops"' 2026-02-17T12:21:10.541 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:400: TEST_profile_disallow_builtin_params_override: echo high_recovery_ops 2026-02-17T12:21:10.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:400: TEST_profile_disallow_builtin_params_override: cur_mclock_profile=high_recovery_ops 2026-02-17T12:21:10.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:401: TEST_profile_disallow_builtin_params_override: test high_recovery_ops = high_recovery_ops 2026-02-17T12:21:10.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:403: TEST_profile_disallow_builtin_params_override: options=('osd_mclock_scheduler_background_recovery_res' 'osd_mclock_scheduler_client_res') 2026-02-17T12:21:10.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:403: TEST_profile_disallow_builtin_params_override: declare -a options 2026-02-17T12:21:10.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:406: TEST_profile_disallow_builtin_params_override: local retries=10 2026-02-17T12:21:10.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:407: TEST_profile_disallow_builtin_params_override: local errors=0 2026-02-17T12:21:10.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:408: TEST_profile_disallow_builtin_params_override: for opt in "${options[@]}" 2026-02-17T12:21:10.543 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: jq .osd_mclock_scheduler_background_recovery_res 2026-02-17T12:21:10.543 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: bc 2026-02-17T12:21:10.543 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: get_asok_path osd.0 2026-02-17T12:21:10.543 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:21:10.543 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:21:10.544 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:10.544 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:10.544 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:10.544 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:21:10.544 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: CEPH_ARGS= 2026-02-17T12:21:10.544 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_background_recovery_res 2026-02-17T12:21:10.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: local opt_val_orig=0.700000 2026-02-17T12:21:10.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: echo '0.700000 + 0.1' 2026-02-17T12:21:10.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:10.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: local opt_val_new=.800000 2026-02-17T12:21:10.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:414: TEST_profile_disallow_builtin_params_override: ceph tell osd.0 config set osd_mclock_scheduler_background_recovery_res .800000 2026-02-17T12:21:10.648 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:21:10.649 INFO:tasks.workunit.client.0.trial155.stdout: "success": "osd_mclock_scheduler_background_recovery_res = '' " 2026-02-17T12:21:10.649 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:21:10.653 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: expr 10 - 1 2026-02-17T12:21:10.654 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: seq 0 9 2026-02-17T12:21:10.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: for count in $(seq 0 $(expr $retries - 1)) 2026-02-17T12:21:10.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:419: TEST_profile_disallow_builtin_params_override: errors=0 2026-02-17T12:21:10.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:420: TEST_profile_disallow_builtin_params_override: sleep 2 2026-02-17T12:21:12.656 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:422: TEST_profile_disallow_builtin_params_override: echo 'Check configuration values - Attempt#: 0' 2026-02-17T12:21:12.656 INFO:tasks.workunit.client.0.trial155.stdout:Check configuration values - Attempt#: 0 2026-02-17T12:21:12.656 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:424: TEST_profile_disallow_builtin_params_override: ceph config get osd.0 osd_mclock_scheduler_background_recovery_res 2026-02-17T12:21:12.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:424: TEST_profile_disallow_builtin_params_override: local res=0.000000 2026-02-17T12:21:12.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:425: TEST_profile_disallow_builtin_params_override: echo 'Mon db (or default): osd.0 osd_mclock_scheduler_background_recovery_res = 0.000000' 2026-02-17T12:21:12.845 INFO:tasks.workunit.client.0.trial155.stdout:Mon db (or default): osd.0 osd_mclock_scheduler_background_recovery_res = 0.000000 2026-02-17T12:21:12.845 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: echo '0.000000 == .800000' 2026-02-17T12:21:12.845 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:12.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: (( 0 )) 2026-02-17T12:21:12.846 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: ceph config show osd.0 2026-02-17T12:21:12.846 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: grep osd_mclock_scheduler_background_recovery_res 2026-02-17T12:21:12.846 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: awk '{ print $2 }' 2026-02-17T12:21:12.846 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: bc 2026-02-17T12:21:13.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: res=.700000 2026-02-17T12:21:13.035 INFO:tasks.workunit.client.0.trial155.stdout:Running config: osd.0 osd_mclock_scheduler_background_recovery_res = .700000 2026-02-17T12:21:13.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:433: TEST_profile_disallow_builtin_params_override: echo 'Running config: osd.0 osd_mclock_scheduler_background_recovery_res = .700000' 2026-02-17T12:21:13.036 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: echo '.700000 == .800000' 2026-02-17T12:21:13.036 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:13.037 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: echo '.700000 != 0.700000' 2026-02-17T12:21:13.037 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:13.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: (( 0 || 0 )) 2026-02-17T12:21:13.039 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: jq .osd_mclock_scheduler_background_recovery_res 2026-02-17T12:21:13.039 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: bc 2026-02-17T12:21:13.039 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: get_asok_path osd.0 2026-02-17T12:21:13.040 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:21:13.040 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:21:13.040 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:13.040 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:13.040 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:13.040 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:21:13.041 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: CEPH_ARGS= 2026-02-17T12:21:13.041 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_background_recovery_res 2026-02-17T12:21:13.090 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: res=0.700000 2026-02-17T12:21:13.090 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:442: TEST_profile_disallow_builtin_params_override: echo 'Values map: osd.0 osd_mclock_scheduler_background_recovery_res = 0.700000' 2026-02-17T12:21:13.091 INFO:tasks.workunit.client.0.trial155.stdout:Values map: osd.0 osd_mclock_scheduler_background_recovery_res = 0.700000 2026-02-17T12:21:13.091 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: echo '0.700000 == .800000' 2026-02-17T12:21:13.091 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:13.092 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: echo '0.700000 != 0.700000' 2026-02-17T12:21:13.092 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:13.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: (( 0 || 0 )) 2026-02-17T12:21:13.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:449: TEST_profile_disallow_builtin_params_override: '[' 0 -eq 0 ']' 2026-02-17T12:21:13.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:451: TEST_profile_disallow_builtin_params_override: break 2026-02-17T12:21:13.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:408: TEST_profile_disallow_builtin_params_override: for opt in "${options[@]}" 2026-02-17T12:21:13.095 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: jq .osd_mclock_scheduler_client_res 2026-02-17T12:21:13.095 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: get_asok_path osd.0 2026-02-17T12:21:13.095 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: bc 2026-02-17T12:21:13.095 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:21:13.095 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:21:13.096 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:13.096 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:13.096 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:13.096 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:21:13.096 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: CEPH_ARGS= 2026-02-17T12:21:13.096 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-17T12:21:13.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:412: TEST_profile_disallow_builtin_params_override: local opt_val_orig=0.300000 2026-02-17T12:21:13.141 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: echo '0.300000 + 0.1' 2026-02-17T12:21:13.142 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:13.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:413: TEST_profile_disallow_builtin_params_override: local opt_val_new=.400000 2026-02-17T12:21:13.143 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:414: TEST_profile_disallow_builtin_params_override: ceph tell osd.0 config set osd_mclock_scheduler_client_res .400000 2026-02-17T12:21:13.197 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:21:13.198 INFO:tasks.workunit.client.0.trial155.stdout: "success": "osd_mclock_scheduler_client_res = '' " 2026-02-17T12:21:13.198 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:21:13.202 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: expr 10 - 1 2026-02-17T12:21:13.203 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: seq 0 9 2026-02-17T12:21:13.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:417: TEST_profile_disallow_builtin_params_override: for count in $(seq 0 $(expr $retries - 1)) 2026-02-17T12:21:13.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:419: TEST_profile_disallow_builtin_params_override: errors=0 2026-02-17T12:21:13.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:420: TEST_profile_disallow_builtin_params_override: sleep 2 2026-02-17T12:21:15.205 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:422: TEST_profile_disallow_builtin_params_override: echo 'Check configuration values - Attempt#: 0' 2026-02-17T12:21:15.206 INFO:tasks.workunit.client.0.trial155.stdout:Check configuration values - Attempt#: 0 2026-02-17T12:21:15.206 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:424: TEST_profile_disallow_builtin_params_override: ceph config get osd.0 osd_mclock_scheduler_client_res 2026-02-17T12:21:15.394 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:424: TEST_profile_disallow_builtin_params_override: local res=0.000000 2026-02-17T12:21:15.394 INFO:tasks.workunit.client.0.trial155.stdout:Mon db (or default): osd.0 osd_mclock_scheduler_client_res = 0.000000 2026-02-17T12:21:15.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:425: TEST_profile_disallow_builtin_params_override: echo 'Mon db (or default): osd.0 osd_mclock_scheduler_client_res = 0.000000' 2026-02-17T12:21:15.395 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: echo '0.000000 == .400000' 2026-02-17T12:21:15.395 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:15.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:426: TEST_profile_disallow_builtin_params_override: (( 0 )) 2026-02-17T12:21:15.396 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: ceph config show osd.0 2026-02-17T12:21:15.396 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: grep osd_mclock_scheduler_client_res 2026-02-17T12:21:15.396 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: awk '{ print $2 }' 2026-02-17T12:21:15.397 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: bc 2026-02-17T12:21:15.582 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:432: TEST_profile_disallow_builtin_params_override: res=.300000 2026-02-17T12:21:15.582 INFO:tasks.workunit.client.0.trial155.stdout:Running config: osd.0 osd_mclock_scheduler_client_res = .300000 2026-02-17T12:21:15.583 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:433: TEST_profile_disallow_builtin_params_override: echo 'Running config: osd.0 osd_mclock_scheduler_client_res = .300000' 2026-02-17T12:21:15.583 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: echo '.300000 == .400000' 2026-02-17T12:21:15.583 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:15.584 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: echo '.300000 != 0.300000' 2026-02-17T12:21:15.584 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:15.585 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:435: TEST_profile_disallow_builtin_params_override: (( 0 || 0 )) 2026-02-17T12:21:15.586 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: jq .osd_mclock_scheduler_client_res 2026-02-17T12:21:15.586 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: bc 2026-02-17T12:21:15.586 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: get_asok_path osd.0 2026-02-17T12:21:15.586 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:21:15.586 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:21:15.587 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:15.587 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:15.587 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:15.587 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:21:15.588 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: CEPH_ARGS= 2026-02-17T12:21:15.588 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_mclock_scheduler_client_res 2026-02-17T12:21:15.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:441: TEST_profile_disallow_builtin_params_override: res=0.300000 2026-02-17T12:21:15.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:442: TEST_profile_disallow_builtin_params_override: echo 'Values map: osd.0 osd_mclock_scheduler_client_res = 0.300000' 2026-02-17T12:21:15.634 INFO:tasks.workunit.client.0.trial155.stdout:Values map: osd.0 osd_mclock_scheduler_client_res = 0.300000 2026-02-17T12:21:15.634 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: echo '0.300000 == .400000' 2026-02-17T12:21:15.635 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:15.635 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: echo '0.300000 != 0.300000' 2026-02-17T12:21:15.635 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: bc -l 2026-02-17T12:21:15.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:444: TEST_profile_disallow_builtin_params_override: (( 0 || 0 )) 2026-02-17T12:21:15.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:449: TEST_profile_disallow_builtin_params_override: '[' 0 -eq 0 ']' 2026-02-17T12:21:15.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:451: TEST_profile_disallow_builtin_params_override: break 2026-02-17T12:21:15.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:459: TEST_profile_disallow_builtin_params_override: teardown td/mclock-config 2026-02-17T12:21:15.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:21:15.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:21:15.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:21:15.638 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:15.638 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:15.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:15.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:15.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:15.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:15.744 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:15.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:15.745 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:15.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:15.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:15.747 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:15.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:15.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:15.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:15.748 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:15.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:15.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:21:15.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:21:15.753 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:15.753 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:15.753 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:15.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:21:15.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:15.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:15.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-17T12:21:15.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:21:15.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:21:15.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:21:15.756 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:15.756 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:15.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:15.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:15.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:15.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:15.757 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:15.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:15.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:15.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:15.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:15.759 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:15.760 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:15.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:15.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:21:15.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:21:15.763 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:15.763 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:15.763 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:15.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:21:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:31: run: for func in $funcs 2026-02-17T12:21:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:32: run: setup td/mclock-config 2026-02-17T12:21:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/mclock-config 2026-02-17T12:21:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/mclock-config 2026-02-17T12:21:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:21:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:21:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:21:15.766 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:15.766 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:15.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:15.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:15.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:15.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:15.767 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:15.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:15.768 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:15.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:15.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:15.769 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:15.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:15.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:15.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:15.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:15.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:15.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:21:15.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:21:15.773 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:15.773 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:15.773 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:15.773 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:21:15.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:15.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:15.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/mclock-config 2026-02-17T12:21:15.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:21:15.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:15.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:15.775 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37494 2026-02-17T12:21:15.776 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:21:15.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:21:15.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:21:15.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-17T12:21:15.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:33: run: TEST_recovery_limit_adjustment_mclock td/mclock-config 2026-02-17T12:21:15.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:202: TEST_recovery_limit_adjustment_mclock: local dir=td/mclock-config 2026-02-17T12:21:15.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:204: TEST_recovery_limit_adjustment_mclock: setup td/mclock-config 2026-02-17T12:21:15.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/mclock-config 2026-02-17T12:21:15.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/mclock-config 2026-02-17T12:21:15.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:21:15.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:21:15.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:21:15.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:15.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:15.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:15.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:15.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:15.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:15.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:15.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:15.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:15.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:15.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:15.781 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:15.782 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:15.782 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:15.782 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:15.782 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:15.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:15.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:21:15.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:21:15.785 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:15.785 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:15.785 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:15.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:21:15.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:15.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:15.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/mclock-config 2026-02-17T12:21:15.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:21:15.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:15.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:15.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37494 2026-02-17T12:21:15.788 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:21:15.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:21:15.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:21:15.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/mclock-config 1' TERM HUP INT 2026-02-17T12:21:15.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:205: TEST_recovery_limit_adjustment_mclock: run_mon td/mclock-config a 2026-02-17T12:21:15.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/mclock-config 2026-02-17T12:21:15.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:21:15.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:21:15.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:21:15.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/mclock-config/a 2026-02-17T12:21:15.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/mclock-config/a --run-dir=td/mclock-config 2026-02-17T12:21:15.808 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:21:15.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:21:15.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:21:15.809 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:21:15.809 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:15.809 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:15.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:21:15.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mclock-config/a '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --mon-cluster-log-file=td/mclock-config/log --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:21:15.834 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:21:15.835 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:21:15.835 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:21:15.835 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:21:15.835 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:21:15.835 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:21:15.835 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:21:15.835 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:21:15.836 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:21:15.836 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:15.837 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:15.837 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:15.837 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:21:15.837 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:21:15.837 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get fsid 2026-02-17T12:21:15.883 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:21:15.883 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:21:15.883 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:21:15.883 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:21:15.883 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:21:15.883 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:21:15.884 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:21:15.884 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:21:15.884 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:15.885 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:15.885 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:15.885 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-mon.a.asok 2026-02-17T12:21:15.885 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:21:15.885 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37494/ceph-mon.a.asok config get mon_host 2026-02-17T12:21:15.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:206: TEST_recovery_limit_adjustment_mclock: run_mgr td/mclock-config x 2026-02-17T12:21:15.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/mclock-config 2026-02-17T12:21:15.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:21:15.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:21:15.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:21:15.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/mclock-config/x 2026-02-17T12:21:15.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:21:16.028 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:21:16.028 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:21:16.028 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:21:16.028 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:21:16.028 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:16.028 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:16.028 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:21:16.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:21:16.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mclock-config/x '--log-file=td/mclock-config/$name.log' '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --run-dir=td/mclock-config '--pid-file=td/mclock-config/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:21:16.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:208: TEST_recovery_limit_adjustment_mclock: run_osd td/mclock-config 0 --osd_op_queue=mclock_scheduler 2026-02-17T12:21:16.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/mclock-config 2026-02-17T12:21:16.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:21:16.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:21:16.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:21:16.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/mclock-config/0 2026-02-17T12:21:16.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 ' 2026-02-17T12:21:16.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:21:16.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:21:16.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:21:16.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/mclock-config/0' 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/mclock-config/0/journal' 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/mclock-config' 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:21:16.049 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/mclock-config/$name.log' 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/mclock-config/$name.pid' 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-17T12:21:16.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/mclock-config/0 2026-02-17T12:21:16.051 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:21:16.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=f7f9bbe6-d013-4bc2-872e-0d526aebb367 2026-02-17T12:21:16.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 f7f9bbe6-d013-4bc2-872e-0d526aebb367' 2026-02-17T12:21:16.052 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 f7f9bbe6-d013-4bc2-872e-0d526aebb367 2026-02-17T12:21:16.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:21:16.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA8XZRplQCEAxAA5HnJjeQ1Gu0LZw/LfPtL+w== 2026-02-17T12:21:16.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA8XZRplQCEAxAA5HnJjeQ1Gu0LZw/LfPtL+w=="}' 2026-02-17T12:21:16.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new f7f9bbe6-d013-4bc2-872e-0d526aebb367 -i td/mclock-config/0/new.json 2026-02-17T12:21:16.162 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:21:16.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/mclock-config/0/new.json 2026-02-17T12:21:16.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQA8XZRplQCEAxAA5HnJjeQ1Gu0LZw/LfPtL+w== --osd-uuid f7f9bbe6-d013-4bc2-872e-0d526aebb367 2026-02-17T12:21:16.186 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:16.185+0000 7fbe8fc0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:16.188 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:16.186+0000 7fbe8fc0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:16.189 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:16.187+0000 7fbe8fc0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:16.189 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:16.188+0000 7fbe8fc0c780 -1 bdev(0x558a4afcfc00 td/mclock-config/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:21:16.189 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:16.188+0000 7fbe8fc0c780 -1 bluestore(td/mclock-config/0) _read_fsid unparsable uuid 2026-02-17T12:21:19.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/mclock-config/0/keyring 2026-02-17T12:21:19.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:21:19.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:21:19.082 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:21:19.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/mclock-config/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:21:19.338 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:21:19.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:21:19.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=10f00b4f-4065-4985-b36e-7b55d5426813 --auth-supported=none --mon-host=127.0.0.1:7124 --debug-mclock 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mclock-config/0 --osd-journal=td/mclock-config/0/journal --chdir= --run-dir=td/mclock-config '--admin-socket=/tmp/ceph-asok.37494/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mclock-config/$name.log' '--pid-file=td/mclock-config/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-17T12:21:19.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:21:19.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:21:19.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:21:19.354 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:19.352+0000 7fd3cba9d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:19.355 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:19.354+0000 7fd3cba9d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:19.356 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:19.355+0000 7fd3cba9d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:19.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:21:19.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:21:19.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:21:19.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:21:19.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:21:19.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:19.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:21:19.526 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:21:19.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:19.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:19.717 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:20.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:20.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:20.719 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:21:20.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:21:20.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:20.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:20.909 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:20.933 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:20.932+0000 7fd3cba9d780 -1 Falling back to public interface 2026-02-17T12:21:21.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:21.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:21.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:21:21.910 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:21:21.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:21.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:22.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:23.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:23.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:23.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:21:23.099 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:21:23.100 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:23.100 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:23.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:23.875 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:23.873+0000 7fd3cba9d780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:21:24.285 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:24.286 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:24.286 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:21:24.286 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:21:24.287 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:24.287 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:24.474 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4096632797,v1:127.0.0.1:6803/4096632797] [v2:127.0.0.1:6804/4096632797,v1:127.0.0.1:6805/4096632797] exists,up f7f9bbe6-d013-4bc2-872e-0d526aebb367 2026-02-17T12:21:24.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:21:24.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:21:24.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:21:24.476 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:210: TEST_recovery_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:21:24.476 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:21:24.477 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:21:24.477 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:24.477 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:24.477 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:24.477 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:21:24.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:210: TEST_recovery_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:21:24.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:210: TEST_recovery_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_recovery_max_active 2026-02-17T12:21:24.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:210: TEST_recovery_limit_adjustment_mclock: local 'recoveries={"osd_recovery_max_active":"0"}' 2026-02-17T12:21:24.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:212: TEST_recovery_limit_adjustment_mclock: echo '{"osd_recovery_max_active":"0"}' 2026-02-17T12:21:24.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:212: TEST_recovery_limit_adjustment_mclock: grep --quiet osd_recovery_max_active 2026-02-17T12:21:24.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:217: TEST_recovery_limit_adjustment_mclock: ceph config set osd.0 osd_recovery_max_active 10 2026-02-17T12:21:24.713 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:218: TEST_recovery_limit_adjustment_mclock: sleep 2 2026-02-17T12:21:26.716 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:220: TEST_recovery_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:21:26.716 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:21:26.716 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:21:26.716 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:26.716 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:26.716 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:26.717 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:21:26.717 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:220: TEST_recovery_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:21:26.717 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:220: TEST_recovery_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_recovery_max_active 2026-02-17T12:21:26.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:220: TEST_recovery_limit_adjustment_mclock: local 'max_recoveries={"osd_recovery_max_active":"0"}' 2026-02-17T12:21:26.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:221: TEST_recovery_limit_adjustment_mclock: test '{"osd_recovery_max_active":"0"}' = '{"osd_recovery_max_active":"0"}' 2026-02-17T12:21:26.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:225: TEST_recovery_limit_adjustment_mclock: ceph config set osd.0 osd_mclock_override_recovery_settings true 2026-02-17T12:21:26.959 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:226: TEST_recovery_limit_adjustment_mclock: ceph config set osd.0 osd_recovery_max_active 10 2026-02-17T12:21:27.147 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:227: TEST_recovery_limit_adjustment_mclock: sleep 2 2026-02-17T12:21:29.150 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:229: TEST_recovery_limit_adjustment_mclock: get_asok_path osd.0 2026-02-17T12:21:29.150 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:21:29.150 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:21:29.150 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:29.151 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:29.151 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:29.151 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37494/ceph-osd.0.asok 2026-02-17T12:21:29.151 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:229: TEST_recovery_limit_adjustment_mclock: CEPH_ARGS= 2026-02-17T12:21:29.151 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:229: TEST_recovery_limit_adjustment_mclock: ceph --format=json daemon /tmp/ceph-asok.37494/ceph-osd.0.asok config get osd_recovery_max_active 2026-02-17T12:21:29.200 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:229: TEST_recovery_limit_adjustment_mclock: max_recoveries='{"osd_recovery_max_active":"10"}' 2026-02-17T12:21:29.200 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:230: TEST_recovery_limit_adjustment_mclock: test '{"osd_recovery_max_active":"10"}' = '{"osd_recovery_max_active":"10"}' 2026-02-17T12:21:29.200 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:232: TEST_recovery_limit_adjustment_mclock: teardown td/mclock-config 2026-02-17T12:21:29.200 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:21:29.200 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:21:29.200 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:21:29.200 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:29.200 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:29.200 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:29.200 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:29.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:29.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:29.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:29.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:29.308 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:29.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:29.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:29.310 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:29.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:29.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:29.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:29.312 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:29.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:29.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:21:29.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:21:29.317 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:29.317 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:29.317 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:29.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:21:29.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:29.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:29.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh:34: run: teardown td/mclock-config 2026-02-17T12:21:29.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:21:29.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:21:29.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:21:29.319 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:29.319 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:29.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:29.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:29.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:29.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:29.321 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:29.321 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:29.322 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:29.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:29.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:29.323 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:29.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:29.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:29.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:29.324 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:29.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:29.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:21:29.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:21:29.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:29.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:29.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:29.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:21:29.328 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:29.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:29.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T12:21:29.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/mclock-config 0 2026-02-17T12:21:29.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/mclock-config 2026-02-17T12:21:29.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T12:21:29.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/mclock-config KILL 2026-02-17T12:21:29.329 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:29.329 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:29.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:29.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:29.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:29.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:29.330 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:29.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:29.331 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:29.333 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:29.333 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:29.333 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:29.334 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:29.334 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:29.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:29.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T12:21:29.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/mclock-config 2026-02-17T12:21:29.337 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:29.337 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:29.337 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37494 2026-02-17T12:21:29.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37494 2026-02-17T12:21:29.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:29.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:29.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T12:21:29.339 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T12:21:29.339 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T12:21:29.403 INFO:tasks.workunit:Running workunit misc/network-ping.sh... 2026-02-17T12:21:29.404 DEBUG:teuthology.orchestra.run.trial155:workunit test misc/network-ping.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c96dfb3f50b3d02598a82af7104764bfdcd3919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh 2026-02-17T12:21:29.466 INFO:tasks.workunit.client.0.trial155.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T12:21:29.470 INFO:tasks.workunit.client.0.trial155.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T12:21:29.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:21:29.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:21:29.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T12:21:29.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T12:21:29.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T12:21:29.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T12:21:29.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T12:21:29.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T12:21:29.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/network-ping 2026-02-17T12:21:29.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:6: run: local dir=td/network-ping 2026-02-17T12:21:29.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:7: run: shift 2026-02-17T12:21:29.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:9: run: export CEPH_MON=127.0.0.1:7146 2026-02-17T12:21:29.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:9: run: CEPH_MON=127.0.0.1:7146 2026-02-17T12:21:29.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:10: run: export CEPH_ARGS 2026-02-17T12:21:29.472 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:11: run: uuidgen 2026-02-17T12:21:29.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:11: run: CEPH_ARGS+='--fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none ' 2026-02-17T12:21:29.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:12: run: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-17T12:21:29.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:13: run: CEPH_ARGS+='--debug_disable_randomized_ping=true ' 2026-02-17T12:21:29.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:14: run: CEPH_ARGS+='--debug_heartbeat_testing_span=5 ' 2026-02-17T12:21:29.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:15: run: CEPH_ARGS+='--osd_heartbeat_interval=1 ' 2026-02-17T12:21:29.472 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:16: run: set 2026-02-17T12:21:29.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:16: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T12:21:29.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:16: run: local 'funcs=TEST_network_ping_test1 2026-02-17T12:21:29.475 INFO:tasks.workunit.client.0.trial155.stderr:TEST_network_ping_test2' 2026-02-17T12:21:29.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:17: run: for func in $funcs 2026-02-17T12:21:29.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:18: run: setup td/network-ping 2026-02-17T12:21:29.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/network-ping 2026-02-17T12:21:29.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/network-ping 2026-02-17T12:21:29.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/network-ping 2026-02-17T12:21:29.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:21:29.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/network-ping KILL 2026-02-17T12:21:29.475 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:21:29.475 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:21:29.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:21:29.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:21:29.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:21:29.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:21:29.476 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:21:29.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:21:29.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:21:29.477 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:21:29.477 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:21:29.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:21:29.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:29.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:21:29.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:21:29.478 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:21:29.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:29.479 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:21:29.479 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/network-ping 2026-02-17T12:21:29.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:21:29.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:29.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:21:29.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.51574 2026-02-17T12:21:29.481 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:21:29.481 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:21:29.481 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/network-ping 2026-02-17T12:21:29.482 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:21:29.482 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:29.482 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:21:29.482 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.51574 2026-02-17T12:21:29.483 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:21:29.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/network-ping 1' TERM HUP INT 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:19: run: TEST_network_ping_test1 td/network-ping 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:25: TEST_network_ping_test1: local dir=td/network-ping 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:27: TEST_network_ping_test1: run_mon td/network-ping a 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/network-ping 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/network-ping/a 2026-02-17T12:21:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/network-ping/a --run-dir=td/network-ping 2026-02-17T12:21:29.503 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:21:29.504 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:21:29.504 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:21:29.504 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:21:29.504 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:29.504 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:21:29.504 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:21:29.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/network-ping/a '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --mon-cluster-log-file=td/network-ping/log --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:21:29.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:21:29.529 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:21:29.530 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:21:29.530 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:21:29.530 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:21:29.530 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:21:29.530 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:21:29.530 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:21:29.530 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:21:29.530 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:29.530 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:29.530 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:21:29.530 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-mon.a.asok 2026-02-17T12:21:29.531 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:21:29.531 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.51574/ceph-mon.a.asok config get fsid 2026-02-17T12:21:29.575 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:21:29.576 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:21:29.576 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:21:29.576 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:21:29.576 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:21:29.576 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:21:29.576 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:21:29.576 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:21:29.576 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:21:29.576 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:29.576 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:21:29.576 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-mon.a.asok 2026-02-17T12:21:29.577 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:21:29.577 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.51574/ceph-mon.a.asok config get mon_host 2026-02-17T12:21:29.619 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:28: TEST_network_ping_test1: run_mgr td/network-ping x 2026-02-17T12:21:29.620 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/network-ping 2026-02-17T12:21:29.620 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:21:29.620 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:21:29.620 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:21:29.620 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/network-ping/x 2026-02-17T12:21:29.620 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:21:29.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:21:29.720 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:21:29.720 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:21:29.720 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:21:29.720 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:29.720 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:21:29.720 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:21:29.721 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:21:29.721 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/network-ping/x '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:21:29.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:29: TEST_network_ping_test1: run_osd td/network-ping 0 2026-02-17T12:21:29.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/network-ping 2026-02-17T12:21:29.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:21:29.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:21:29.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:21:29.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/network-ping/0 2026-02-17T12:21:29.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/network-ping/0' 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/network-ping/0/journal' 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:21:29.742 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:21:29.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:21:29.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:21:29.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:21:29.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:21:29.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/network-ping/0 2026-02-17T12:21:29.744 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:21:29.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c0286db1-901a-4e5e-ba75-9bd31a979152 2026-02-17T12:21:29.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 c0286db1-901a-4e5e-ba75-9bd31a979152' 2026-02-17T12:21:29.744 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 c0286db1-901a-4e5e-ba75-9bd31a979152 2026-02-17T12:21:29.745 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:21:29.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBJXZRpxIzJLBAANXlpW3nwbhcmVBtrbxQQRg== 2026-02-17T12:21:29.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBJXZRpxIzJLBAANXlpW3nwbhcmVBtrbxQQRg=="}' 2026-02-17T12:21:29.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c0286db1-901a-4e5e-ba75-9bd31a979152 -i td/network-ping/0/new.json 2026-02-17T12:21:29.854 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:21:29.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/network-ping/0/new.json 2026-02-17T12:21:29.862 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBJXZRpxIzJLBAANXlpW3nwbhcmVBtrbxQQRg== --osd-uuid c0286db1-901a-4e5e-ba75-9bd31a979152 2026-02-17T12:21:29.880 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:29.879+0000 7f6e9422e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:29.881 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:29.880+0000 7f6e9422e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:29.882 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:29.881+0000 7f6e9422e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:29.883 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:29.881+0000 7f6e9422e780 -1 bdev(0x55e6260b1c00 td/network-ping/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:21:29.883 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:29.881+0000 7f6e9422e780 -1 bluestore(td/network-ping/0) _read_fsid unparsable uuid 2026-02-17T12:21:32.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/network-ping/0/keyring 2026-02-17T12:21:32.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:21:32.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:21:32.296 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:21:32.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/network-ping/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:21:32.551 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:21:32.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:21:32.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:21:32.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:21:32.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:21:32.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:21:32.567 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:32.566+0000 7f4d6d83d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:32.568 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:32.567+0000 7f4d6d83d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:32.569 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:32.568+0000 7f4d6d83d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:32.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:21:32.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:21:32.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:21:32.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:21:32.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:21:32.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:32.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:21:32.740 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:21:32.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:32.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:32.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:33.906 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:33.905+0000 7f4d6d83d780 -1 Falling back to public interface 2026-02-17T12:21:33.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:33.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:33.928 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:21:33.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:21:33.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:33.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:34.114 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:35.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:35.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:35.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:21:35.116 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:21:35.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:35.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:35.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:36.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:36.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:36.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:21:36.314 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:21:36.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:36.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:36.500 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:36.599 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:36.598+0000 7f4d6d83d780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:21:37.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:37.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:37.502 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:21:37.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:21:37.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:37.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:21:37.693 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3498780252,v1:127.0.0.1:6803/3498780252] [v2:127.0.0.1:6804/3498780252,v1:127.0.0.1:6805/3498780252] exists,up c0286db1-901a-4e5e-ba75-9bd31a979152 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:30: TEST_network_ping_test1: run_osd td/network-ping 1 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/network-ping 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/network-ping/1 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/network-ping/1' 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/network-ping/1/journal' 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:21:37.694 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:21:37.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/network-ping/1 2026-02-17T12:21:37.696 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:21:37.696 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=842786ec-9fe2-4762-8d7d-18e958db1ead 2026-02-17T12:21:37.696 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 842786ec-9fe2-4762-8d7d-18e958db1ead' 2026-02-17T12:21:37.696 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 842786ec-9fe2-4762-8d7d-18e958db1ead 2026-02-17T12:21:37.697 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:21:37.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBRXZRpi/csKhAArQOePdCvGimdXOAO/vKppw== 2026-02-17T12:21:37.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBRXZRpi/csKhAArQOePdCvGimdXOAO/vKppw=="}' 2026-02-17T12:21:37.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 842786ec-9fe2-4762-8d7d-18e958db1ead -i td/network-ping/1/new.json 2026-02-17T12:21:37.901 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:21:37.908 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/network-ping/1/new.json 2026-02-17T12:21:37.909 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBRXZRpi/csKhAArQOePdCvGimdXOAO/vKppw== --osd-uuid 842786ec-9fe2-4762-8d7d-18e958db1ead 2026-02-17T12:21:37.927 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:37.926+0000 7fcc22f19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:37.928 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:37.927+0000 7fcc22f19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:37.929 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:37.928+0000 7fcc22f19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:37.930 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:37.928+0000 7fcc22f19780 -1 bdev(0x5559d2021c00 td/network-ping/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:21:37.930 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:37.928+0000 7fcc22f19780 -1 bluestore(td/network-ping/1) _read_fsid unparsable uuid 2026-02-17T12:21:40.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/network-ping/1/keyring 2026-02-17T12:21:40.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:21:40.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:21:40.045 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:21:40.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/network-ping/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:21:40.304 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:21:40.305 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:21:40.305 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:21:40.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:21:40.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:21:40.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:21:40.321 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:40.320+0000 7f64018ba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:40.323 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:40.321+0000 7f64018ba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:40.324 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:40.322+0000 7f64018ba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:40.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:21:40.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:21:40.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:21:40.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:21:40.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:21:40.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:40.493 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:21:40.493 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:21:40.493 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:40.494 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:21:40.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:41.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:41.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:41.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:21:41.680 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:21:41.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:41.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:21:41.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:41.913 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:41.912+0000 7f64018ba780 -1 Falling back to public interface 2026-02-17T12:21:42.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:42.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:42.870 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:21:42.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:21:42.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:42.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:21:43.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:44.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:44.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:44.059 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:21:44.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:21:44.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:44.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:21:44.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:44.846 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:44.845+0000 7f64018ba780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:21:45.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:45.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:45.247 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:21:45.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:21:45.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:45.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:21:45.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:46.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:46.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:46.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:21:46.438 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:21:46.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:46.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:21:46.624 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3791613853,v1:127.0.0.1:6811/3791613853] [v2:127.0.0.1:6812/3791613853,v1:127.0.0.1:6813/3791613853] exists,up 842786ec-9fe2-4762-8d7d-18e958db1ead 2026-02-17T12:21:46.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:21:46.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:21:46.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:21:46.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:31: TEST_network_ping_test1: run_osd td/network-ping 2 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/network-ping 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/network-ping/2 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/network-ping/2' 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/network-ping/2/journal' 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:21:46.625 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/network-ping/2 2026-02-17T12:21:46.626 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:21:46.627 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=33a16579-6dfd-464d-8804-c7661d9548bb 2026-02-17T12:21:46.627 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 33a16579-6dfd-464d-8804-c7661d9548bb' 2026-02-17T12:21:46.627 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 33a16579-6dfd-464d-8804-c7661d9548bb 2026-02-17T12:21:46.628 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:21:46.640 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBaXZRpfJERJhAAakAhzOF97la9tu+1r5ZluQ== 2026-02-17T12:21:46.640 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBaXZRpfJERJhAAakAhzOF97la9tu+1r5ZluQ=="}' 2026-02-17T12:21:46.640 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 33a16579-6dfd-464d-8804-c7661d9548bb -i td/network-ping/2/new.json 2026-02-17T12:21:46.828 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:21:46.835 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/network-ping/2/new.json 2026-02-17T12:21:46.836 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBaXZRpfJERJhAAakAhzOF97la9tu+1r5ZluQ== --osd-uuid 33a16579-6dfd-464d-8804-c7661d9548bb 2026-02-17T12:21:46.854 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:46.853+0000 7f22c1012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:46.855 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:46.854+0000 7f22c1012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:46.856 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:46.855+0000 7f22c1012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:46.857 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:46.855+0000 7f22c1012780 -1 bdev(0x55cf8442fc00 td/network-ping/2/block) open stat got: (1) Operation not permitted 2026-02-17T12:21:46.857 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:46.855+0000 7f22c1012780 -1 bluestore(td/network-ping/2) _read_fsid unparsable uuid 2026-02-17T12:21:48.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/network-ping/2/keyring 2026-02-17T12:21:48.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:21:48.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:21:48.979 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:21:48.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/network-ping/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:21:49.236 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:21:49.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:21:49.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:21:49.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:21:49.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:21:49.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:21:49.254 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:49.253+0000 7f40af82f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:49.255 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:49.254+0000 7f40af82f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:49.256 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:49.255+0000 7f40af82f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:21:49.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:21:49.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:21:49.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:21:49.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:21:49.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:21:49.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:49.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:21:49.426 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:21:49.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:49.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:21:49.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:50.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:50.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:50.615 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:21:50.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:21:50.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:50.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:21:50.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:50.838 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:50.837+0000 7f40af82f780 -1 Falling back to public interface 2026-02-17T12:21:51.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:51.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:51.804 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:21:51.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:21:51.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:51.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:21:51.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:52.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:52.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:52.996 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:21:52.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:21:52.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:52.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:21:53.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:53.789 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:21:53.787+0000 7f40af82f780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:21:54.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:54.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:54.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:21:54.186 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:21:54.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:54.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:21:54.378 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:21:55.379 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:21:55.379 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:21:55.380 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:21:55.380 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:21:55.380 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:21:55.380 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:21:55.568 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3978398656,v1:127.0.0.1:6819/3978398656] [v2:127.0.0.1:6820/3978398656,v1:127.0.0.1:6821/3978398656] exists,up 33a16579-6dfd-464d-8804-c7661d9548bb 2026-02-17T12:21:55.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:21:55.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:21:55.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:21:55.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:33: TEST_network_ping_test1: sleep 5 2026-02-17T12:22:00.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:35: TEST_network_ping_test1: create_pool foo 16 2026-02-17T12:22:00.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create foo 16 2026-02-17T12:22:00.810 INFO:tasks.workunit.client.0.trial155.stderr:pool 'foo' already exists 2026-02-17T12:22:00.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:22:01.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:38: TEST_network_ping_test1: timeout 20 rados bench -p foo 10 write -b 4096 --no-cleanup 2026-02-17T12:22:01.840 INFO:tasks.workunit.client.0.trial155.stdout:hints = 1 2026-02-17T12:22:01.840 INFO:tasks.workunit.client.0.trial155.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 10 seconds or 0 objects 2026-02-17T12:22:01.841 INFO:tasks.workunit.client.0.trial155.stdout:Object prefix: benchmark_data_trial155_56386 2026-02-17T12:22:01.841 INFO:tasks.workunit.client.0.trial155.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T12:22:01.841 INFO:tasks.workunit.client.0.trial155.stdout: 0 0 0 0 0 0 - 0 2026-02-17T12:22:02.840 INFO:tasks.workunit.client.0.trial155.stdout: 1 16 11235 11219 43.821 43.8242 0.0011063 0.00142398 2026-02-17T12:22:03.841 INFO:tasks.workunit.client.0.trial155.stdout: 2 16 22484 22468 43.8795 43.9414 0.00143092 0.00142247 2026-02-17T12:22:04.841 INFO:tasks.workunit.client.0.trial155.stdout: 3 16 34652 34636 45.0955 47.5312 0.00117566 0.00138436 2026-02-17T12:22:05.841 INFO:tasks.workunit.client.0.trial155.stdout: 4 16 46366 46350 45.2603 45.7578 0.00121668 0.00137942 2026-02-17T12:22:06.841 INFO:tasks.workunit.client.0.trial155.stdout: 5 15 58000 57985 45.2974 45.4492 0.00153239 0.00137842 2026-02-17T12:22:07.841 INFO:tasks.workunit.client.0.trial155.stdout: 6 16 69812 69796 45.4366 46.1367 0.0011148 0.00137418 2026-02-17T12:22:08.841 INFO:tasks.workunit.client.0.trial155.stdout: 7 16 81734 81718 45.5981 46.5703 0.00115418 0.00136933 2026-02-17T12:22:09.841 INFO:tasks.workunit.client.0.trial155.stdout: 8 16 91743 91727 44.7851 39.0977 0.00161119 0.00139414 2026-02-17T12:22:10.841 INFO:tasks.workunit.client.0.trial155.stdout: 9 15 101286 101271 43.9511 37.2812 0.0017459 0.00142072 2026-02-17T12:22:11.841 INFO:tasks.workunit.client.0.trial155.stdout: 10 8 110978 110970 43.3444 37.8867 0.00148227 0.00144065 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Total time run: 10.0011 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Total writes made: 110978 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Write size: 4096 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Object size: 4096 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Bandwidth (MB/sec): 43.3462 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Stddev Bandwidth: 3.81747 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Max bandwidth (MB/sec): 47.5312 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Min bandwidth (MB/sec): 37.2812 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Average IOPS: 11096 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Stddev IOPS: 977.272 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Max IOPS: 12168 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Min IOPS: 9544 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Average Latency(s): 0.00144064 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Stddev Latency(s): 0.000659195 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Max latency(s): 0.0137763 2026-02-17T12:22:12.841 INFO:tasks.workunit.client.0.trial155.stdout:Min latency(s): 0.000472474 2026-02-17T12:22:12.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:41: TEST_network_ping_test1: sleep 10 2026-02-17T12:22:22.848 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:42: TEST_network_ping_test1: flush_pg_stats 2026-02-17T12:22:22.848 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:22:22.848 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:22:23.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:22:23.036 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:22:23.036 INFO:tasks.workunit.client.0.trial155.stderr:2' 2026-02-17T12:22:23.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:22:23.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:22:23.036 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:22:23.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836492 2026-02-17T12:22:23.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836492 2026-02-17T12:22:23.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T12:22:23.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:22:23.097 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:22:23.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672970 2026-02-17T12:22:23.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672970 2026-02-17T12:22:23.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492 1-42949672970' 2026-02-17T12:22:23.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:22:23.158 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:22:23.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=64424509448 2026-02-17T12:22:23.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 64424509448 2026-02-17T12:22:23.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-64424509448' 2026-02-17T12:22:23.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:22:23.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836492 2026-02-17T12:22:23.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:22:23.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:22:23.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836492 2026-02-17T12:22:23.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:22:23.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836492 2026-02-17T12:22:23.225 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836492 2026-02-17T12:22:23.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T12:22:23.225 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:22:23.411 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836489 -lt 21474836492 2026-02-17T12:22:23.411 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:22:24.412 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:22:24.412 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:22:24.602 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T12:22:24.603 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:22:24.603 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672970 2026-02-17T12:22:24.603 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:22:24.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:22:24.604 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672970 2026-02-17T12:22:24.604 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:22:24.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672970 2026-02-17T12:22:24.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-17T12:22:24.606 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 42949672970 2026-02-17T12:22:24.606 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:22:24.797 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672970 -lt 42949672970 2026-02-17T12:22:24.797 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:22:24.797 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-64424509448 2026-02-17T12:22:24.797 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:22:24.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:22:24.799 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-64424509448 2026-02-17T12:22:24.799 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:22:24.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=64424509448 2026-02-17T12:22:24.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 64424509448' 2026-02-17T12:22:24.800 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 64424509448 2026-02-17T12:22:24.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:22:25.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 64424509448 -lt 64424509448 2026-02-17T12:22:25.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:22:25.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: get_asok_path osd.0 2026-02-17T12:22:25.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:22:25.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:22:25.052 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:22:25.053 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:22:25.053 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:22:25.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-osd.0.asok 2026-02-17T12:22:25.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:22:25.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-osd.0.asok dump_osd_network 2026-02-17T12:22:25.098 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:22:25.098 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 1000, 2026-02-17T12:22:25.098 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [] 2026-02-17T12:22:25.098 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:22:25.102 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:45: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:25.103 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:45: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:22:25.104 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:45: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:22:25.105 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:46: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:25.105 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:46: TEST_network_ping_test1: jq .threshold 2026-02-17T12:22:25.107 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:46: TEST_network_ping_test1: test 1000 = 1000 2026-02-17T12:22:25.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:22:25.109 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-17T12:22:25.109 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2026-02-17T12:22:25.109 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2026-02-17T12:22:25.109 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:22:25.109 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:22:25.109 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:22:25.109 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-mgr.x.asok 2026-02-17T12:22:25.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:22:25.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-mgr.x.asok dump_osd_network 2026-02-17T12:22:25.148 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:22:25.149 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 1000, 2026-02-17T12:22:25.149 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [] 2026-02-17T12:22:25.149 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:22:25.156 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:49: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:25.156 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:49: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:22:25.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:49: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:22:25.159 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:50: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:25.159 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:50: TEST_network_ping_test1: jq .threshold 2026-02-17T12:22:25.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:50: TEST_network_ping_test1: test 1000 = 1000 2026-02-17T12:22:25.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:22:25.162 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: get_asok_path osd.0 2026-02-17T12:22:25.162 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:22:25.162 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:22:25.162 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:22:25.163 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:22:25.163 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:22:25.163 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-osd.0.asok 2026-02-17T12:22:25.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:22:25.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-osd.0.asok dump_osd_network 0 2026-02-17T12:22:25.207 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:22:25.207 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 0, 2026-02-17T12:22:25.207 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [ 2026-02-17T12:22:25.207 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.207 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:22 2026", 2026-02-17T12:22:25.207 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.207 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:25.207 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:25.207 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.095, 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.240, 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.193 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.102, 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 2.952, 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 2.952 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.102, 2026-02-17T12:22:25.208 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 2.952, 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 2.952 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.173 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:22 2026", 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.078, 2026-02-17T12:22:25.209 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.236, 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.187 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.083, 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 3.052, 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 3.052 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.083, 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 3.052, 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 3.052 2026-02-17T12:22:25.210 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.138 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:20 2026", 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.109, 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.149, 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.141 2026-02-17T12:22:25.211 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.121, 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.270, 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.270 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.121, 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.270, 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.270 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.164 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.212 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:20 2026", 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.132, 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.148, 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.131 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.145, 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.402, 2026-02-17T12:22:25.213 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.402 2026-02-17T12:22:25.214 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.214 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.214 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.145, 2026-02-17T12:22:25.214 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.402, 2026-02-17T12:22:25.214 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.402 2026-02-17T12:22:25.214 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.214 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.150 2026-02-17T12:22:25.214 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:22:25.214 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:22:25.214 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:22:25.215 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:53: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:25.215 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:53: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:22:25.215 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:53: TEST_network_ping_test1: test 4 = 4 2026-02-17T12:22:25.215 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:54: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:25.216 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:54: TEST_network_ping_test1: jq .threshold 2026-02-17T12:22:25.217 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:54: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:22:25.217 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:22:25.218 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-17T12:22:25.218 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2026-02-17T12:22:25.218 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2026-02-17T12:22:25.218 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:22:25.218 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:22:25.218 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:22:25.219 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-mgr.x.asok 2026-02-17T12:22:25.219 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:22:25.219 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-mgr.x.asok dump_osd_network 0 2026-02-17T12:22:25.259 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:22:25.260 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 0, 2026-02-17T12:22:25.260 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [ 2026-02-17T12:22:25.260 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.260 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:22 2026", 2026-02-17T12:22:25.260 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.260 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:25.260 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:25.260 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:25.260 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.260 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.095, 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.240, 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.193 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.091, 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.091, 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.091 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.102, 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 2.952, 2026-02-17T12:22:25.261 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 2.952 2026-02-17T12:22:25.262 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.262 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.097 2026-02-17T12:22:25.262 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.262 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.262 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:22 2026", 2026-02-17T12:22:25.262 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.262 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:25.262 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:25.262 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:25.262 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.262 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.078, 2026-02-17T12:22:25.263 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.236, 2026-02-17T12:22:25.263 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.187 2026-02-17T12:22:25.263 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.263 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.263 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.072, 2026-02-17T12:22:25.263 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.072, 2026-02-17T12:22:25.263 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.072 2026-02-17T12:22:25.263 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.263 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.263 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.083, 2026-02-17T12:22:25.263 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 3.052, 2026-02-17T12:22:25.264 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 3.052 2026-02-17T12:22:25.264 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.264 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.072 2026-02-17T12:22:25.264 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.264 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.264 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:20 2026", 2026-02-17T12:22:25.264 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.264 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:22:25.264 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:22:25.264 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:25.264 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.265 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.098, 2026-02-17T12:22:25.265 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.150, 2026-02-17T12:22:25.265 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.165 2026-02-17T12:22:25.265 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.265 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.265 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.068, 2026-02-17T12:22:25.265 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.068, 2026-02-17T12:22:25.265 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.068 2026-02-17T12:22:25.265 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.265 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.265 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.134, 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.613, 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.613 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.084 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:19 2026", 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:25.266 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.267 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.105, 2026-02-17T12:22:25.267 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.161, 2026-02-17T12:22:25.267 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.135 2026-02-17T12:22:25.267 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.267 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.267 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.082, 2026-02-17T12:22:25.267 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.082, 2026-02-17T12:22:25.267 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.082 2026-02-17T12:22:25.267 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.267 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.267 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.148, 2026-02-17T12:22:25.268 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.575, 2026-02-17T12:22:25.268 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.575 2026-02-17T12:22:25.268 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.268 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.092 2026-02-17T12:22:25.268 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.268 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.268 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:19 2026", 2026-02-17T12:22:25.268 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.268 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:22:25.268 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:25.268 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.121, 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.153, 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.147 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.109, 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.103, 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.103 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.269 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.142, 2026-02-17T12:22:25.270 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.229, 2026-02-17T12:22:25.270 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.229 2026-02-17T12:22:25.270 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.270 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.125 2026-02-17T12:22:25.270 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.270 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.270 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:19 2026", 2026-02-17T12:22:25.270 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.270 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:22:25.270 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:25.270 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.123, 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.149, 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.144 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.107, 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.107, 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.107 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.271 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.149, 2026-02-17T12:22:25.272 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.218, 2026-02-17T12:22:25.272 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.218 2026-02-17T12:22:25.272 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.272 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.093 2026-02-17T12:22:25.272 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.272 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.272 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:20 2026", 2026-02-17T12:22:25.272 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.272 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:25.273 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:25.273 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:25.273 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.273 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.109, 2026-02-17T12:22:25.273 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.149, 2026-02-17T12:22:25.273 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.141 2026-02-17T12:22:25.273 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.273 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.273 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.089, 2026-02-17T12:22:25.273 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.089, 2026-02-17T12:22:25.273 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.089 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.121, 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.270, 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.270 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.107 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:20 2026", 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:25.274 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.132, 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.148, 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.131 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.113, 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.088, 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.088 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.145, 2026-02-17T12:22:25.275 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.402, 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.402 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.141 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:19 2026", 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.115, 2026-02-17T12:22:25.276 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.144, 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.140 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.098, 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.098, 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.098 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.155, 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.197, 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.197 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.277 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.099 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:20 2026", 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.097, 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.119, 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.144 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.278 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.078, 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.078, 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.078 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.125, 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.287, 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.287 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.077 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:19 2026", 2026-02-17T12:22:25.279 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.093, 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.137, 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.113 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.070, 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.070, 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.070 2026-02-17T12:22:25.280 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.115, 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.571, 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.571 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.111 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:19 2026", 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:22:25.281 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.099, 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.131, 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.130 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.078, 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.078, 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.078 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.131, 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.232, 2026-02-17T12:22:25.282 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.232 2026-02-17T12:22:25.283 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:25.283 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.102 2026-02-17T12:22:25.283 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:22:25.283 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:22:25.283 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:22:25.284 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:57: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:25.284 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:57: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:22:25.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:57: TEST_network_ping_test1: test 12 = 12 2026-02-17T12:22:25.299 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:58: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:25.300 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:58: TEST_network_ping_test1: jq .threshold 2026-02-17T12:22:25.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:58: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:22:25.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:61: TEST_network_ping_test1: sleep 20 2026-02-17T12:22:45.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:62: TEST_network_ping_test1: flush_pg_stats 2026-02-17T12:22:45.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:22:45.303 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:22:45.491 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:22:45.491 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:22:45.491 INFO:tasks.workunit.client.0.trial155.stderr:2' 2026-02-17T12:22:45.491 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:22:45.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:22:45.492 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:22:45.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836498 2026-02-17T12:22:45.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836498 2026-02-17T12:22:45.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836498' 2026-02-17T12:22:45.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:22:45.553 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:22:45.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672976 2026-02-17T12:22:45.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672976 2026-02-17T12:22:45.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836498 1-42949672976' 2026-02-17T12:22:45.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:22:45.615 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:22:45.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=64424509455 2026-02-17T12:22:45.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 64424509455 2026-02-17T12:22:45.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836498 1-42949672976 2-64424509455' 2026-02-17T12:22:45.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:22:45.677 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836498 2026-02-17T12:22:45.677 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:22:45.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:22:45.678 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836498 2026-02-17T12:22:45.678 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:22:45.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836498 2026-02-17T12:22:45.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2026-02-17T12:22:45.680 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836498 2026-02-17T12:22:45.680 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:22:45.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836498 -lt 21474836498 2026-02-17T12:22:45.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:22:45.867 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672976 2026-02-17T12:22:45.867 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:22:45.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:22:45.868 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672976 2026-02-17T12:22:45.868 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:22:45.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672976 2026-02-17T12:22:45.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672976' 2026-02-17T12:22:45.870 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 42949672976 2026-02-17T12:22:45.870 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:22:46.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672976 -lt 42949672976 2026-02-17T12:22:46.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:22:46.060 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-64424509455 2026-02-17T12:22:46.060 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:22:46.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:22:46.062 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-64424509455 2026-02-17T12:22:46.062 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:22:46.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=64424509455 2026-02-17T12:22:46.063 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 64424509455 2026-02-17T12:22:46.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 64424509455' 2026-02-17T12:22:46.063 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:22:46.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 64424509455 -lt 64424509455 2026-02-17T12:22:46.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:22:46.258 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: get_asok_path osd.0 2026-02-17T12:22:46.258 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:22:46.258 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:22:46.258 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:22:46.259 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:22:46.259 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:22:46.259 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-osd.0.asok 2026-02-17T12:22:46.259 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:22:46.259 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-osd.0.asok dump_osd_network 2026-02-17T12:22:46.300 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:22:46.300 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 1000, 2026-02-17T12:22:46.300 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [] 2026-02-17T12:22:46.300 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:22:46.304 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:64: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:46.305 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:64: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:22:46.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:64: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:22:46.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:65: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:46.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:65: TEST_network_ping_test1: jq .threshold 2026-02-17T12:22:46.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:65: TEST_network_ping_test1: test 1000 = 1000 2026-02-17T12:22:46.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:22:46.310 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-17T12:22:46.310 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2026-02-17T12:22:46.310 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2026-02-17T12:22:46.311 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:22:46.311 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:22:46.311 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:22:46.311 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-mgr.x.asok 2026-02-17T12:22:46.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:22:46.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-mgr.x.asok dump_osd_network 2026-02-17T12:22:46.351 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:22:46.351 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 1000, 2026-02-17T12:22:46.351 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [] 2026-02-17T12:22:46.351 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:22:46.356 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:68: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:46.356 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:68: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:22:46.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:68: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:22:46.359 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:69: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:46.359 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:69: TEST_network_ping_test1: jq .threshold 2026-02-17T12:22:46.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:69: TEST_network_ping_test1: test 1000 = 1000 2026-02-17T12:22:46.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:22:46.361 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: get_asok_path osd.0 2026-02-17T12:22:46.362 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:22:46.362 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:22:46.362 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:22:46.362 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:22:46.362 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:22:46.362 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-osd.0.asok 2026-02-17T12:22:46.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:22:46.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-osd.0.asok dump_osd_network 0 2026-02-17T12:22:46.405 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 0, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [ 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:42 2026", 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.099, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.122, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.183 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.119, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.260, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 2.952 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.119, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.260, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 2.952 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.406 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.141 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:42 2026", 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.090, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.113, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.177 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.104, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.310, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 3.052 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.104, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.310, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 3.052 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.122 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:45 2026", 2026-02-17T12:22:46.407 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.130, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.153, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.141 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.155, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.294, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.402 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.155, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.294, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.402 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.155 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:45 2026", 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.129, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.137, 2026-02-17T12:22:46.408 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.141 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.166, 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.282, 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.282 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.166, 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.282, 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.282 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.166 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:22:46.409 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:22:46.410 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:72: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:46.410 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:72: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:22:46.412 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:72: TEST_network_ping_test1: test 4 = 4 2026-02-17T12:22:46.413 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:73: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:46.413 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:73: TEST_network_ping_test1: jq .threshold 2026-02-17T12:22:46.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:73: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:22:46.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:22:46.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-17T12:22:46.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2026-02-17T12:22:46.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2026-02-17T12:22:46.416 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:22:46.416 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:22:46.416 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:22:46.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-mgr.x.asok 2026-02-17T12:22:46.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:22:46.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-mgr.x.asok dump_osd_network 0 2026-02-17T12:22:46.457 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:22:46.457 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 0, 2026-02-17T12:22:46.457 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [ 2026-02-17T12:22:46.457 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.457 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:42 2026", 2026-02-17T12:22:46.457 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.099, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.122, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.183 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.091, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.088, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.088 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.119, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.260, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 2.952 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.126 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:42 2026", 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:46.458 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.090, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.113, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.177 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.077, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.072, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.072 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.104, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.310, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 3.052 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.078 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:40 2026", 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.139, 2026-02-17T12:22:46.459 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.153, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.141 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.115, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.113, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.088 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.210, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.294, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.402 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.142 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:40 2026", 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.094, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.100, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.145 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.460 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.078, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.068, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.068 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.108, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.166, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.613 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.071 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:44 2026", 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.116, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.130, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.142 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.105, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.105, 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.103 2026-02-17T12:22:46.461 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.125, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.179, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.229 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.105 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:40 2026", 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.108, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.133, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.141 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.084, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.084, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.084 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.154, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.282, 2026-02-17T12:22:46.462 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.282 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.119 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:44 2026", 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.106, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.124, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.138 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.095, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.093, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.093 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.117, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.171, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.218 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.111 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.463 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:44 2026", 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.102, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.112, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.131 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.090, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.087, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.087 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.119, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.185, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.197 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.101 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:44 2026", 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:46.464 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.111, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.102, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.129 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.083, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.077, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.077 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.166, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.166, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.575 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.083 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:44 2026", 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.113, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.121, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.127 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.465 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.095, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.095, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.078 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.135, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.181, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.232 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.095 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:40 2026", 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.081, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.097, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.127 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.068, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.067, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.067 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.466 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.095, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.161, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.287 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.094 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:22:44 2026", 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.091, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.107, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.115 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.077, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.077, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.070 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.107, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.202, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.571 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.083 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:22:46.467 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:22:46.468 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:76: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:46.468 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:76: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:22:46.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:76: TEST_network_ping_test1: test 12 = 12 2026-02-17T12:22:46.468 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:77: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:22:46.468 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:77: TEST_network_ping_test1: jq .threshold 2026-02-17T12:22:46.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:77: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:22:46.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:81: TEST_network_ping_test1: sleep 50 2026-02-17T12:23:36.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:82: TEST_network_ping_test1: flush_pg_stats 2026-02-17T12:23:36.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:23:36.470 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:23:36.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:23:36.661 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:23:36.661 INFO:tasks.workunit.client.0.trial155.stderr:2' 2026-02-17T12:23:36.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:23:36.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:23:36.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:23:36.723 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836510 2026-02-17T12:23:36.723 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836510 2026-02-17T12:23:36.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836510' 2026-02-17T12:23:36.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:23:36.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:23:36.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672989 2026-02-17T12:23:36.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672989 2026-02-17T12:23:36.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836510 1-42949672989' 2026-02-17T12:23:36.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:23:36.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:23:36.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=64424509467 2026-02-17T12:23:36.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 64424509467 2026-02-17T12:23:36.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836510 1-42949672989 2-64424509467' 2026-02-17T12:23:36.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:23:36.850 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836510 2026-02-17T12:23:36.850 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:23:36.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:23:36.851 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836510 2026-02-17T12:23:36.851 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:23:36.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836510 2026-02-17T12:23:36.853 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2026-02-17T12:23:36.853 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836510 2026-02-17T12:23:36.853 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:23:37.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836508 -lt 21474836510 2026-02-17T12:23:37.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:23:38.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:23:38.042 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:23:38.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836510 -lt 21474836510 2026-02-17T12:23:38.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:23:38.229 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672989 2026-02-17T12:23:38.229 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:23:38.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:23:38.231 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672989 2026-02-17T12:23:38.231 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:23:38.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672989 2026-02-17T12:23:38.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672989' 2026-02-17T12:23:38.232 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 42949672989 2026-02-17T12:23:38.232 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:23:38.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672989 -lt 42949672989 2026-02-17T12:23:38.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:23:38.428 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-64424509467 2026-02-17T12:23:38.428 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:23:38.428 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:23:38.429 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-64424509467 2026-02-17T12:23:38.429 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:23:38.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=64424509467 2026-02-17T12:23:38.430 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 64424509467 2026-02-17T12:23:38.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 64424509467' 2026-02-17T12:23:38.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:23:38.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 64424509467 -lt 64424509467 2026-02-17T12:23:38.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:23:38.623 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: get_asok_path osd.0 2026-02-17T12:23:38.623 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:23:38.623 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:23:38.624 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:23:38.624 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:38.624 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:38.624 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-osd.0.asok 2026-02-17T12:23:38.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:23:38.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-osd.0.asok dump_osd_network 2026-02-17T12:23:38.667 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:23:38.667 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 1000, 2026-02-17T12:23:38.667 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [] 2026-02-17T12:23:38.667 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:23:38.672 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:84: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:23:38.673 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:84: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:23:38.674 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:84: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:23:38.675 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:85: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:23:38.675 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:85: TEST_network_ping_test1: jq .threshold 2026-02-17T12:23:38.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:85: TEST_network_ping_test1: test 1000 = 1000 2026-02-17T12:23:38.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:23:38.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-17T12:23:38.680 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2026-02-17T12:23:38.680 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2026-02-17T12:23:38.680 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:23:38.680 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:38.680 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:38.680 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-mgr.x.asok 2026-02-17T12:23:38.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:23:38.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-mgr.x.asok dump_osd_network 2026-02-17T12:23:38.717 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:23:38.717 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 1000, 2026-02-17T12:23:38.717 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [] 2026-02-17T12:23:38.717 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:23:38.722 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:88: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:23:38.722 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:88: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:23:38.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:88: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:23:38.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:89: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:23:38.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:89: TEST_network_ping_test1: jq .threshold 2026-02-17T12:23:38.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:89: TEST_network_ping_test1: test 1000 = 1000 2026-02-17T12:23:38.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:23:38.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: get_asok_path osd.0 2026-02-17T12:23:38.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:23:38.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:23:38.728 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:23:38.728 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:38.728 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:38.728 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-osd.0.asok 2026-02-17T12:23:38.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:23:38.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-osd.0.asok dump_osd_network 0 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 0, 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [ 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:35 2026", 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.125, 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.131, 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.141 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.134, 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.203, 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.359 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.770 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.134, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.203, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.359 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.168 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:37 2026", 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.137, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.121, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.121 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.206, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.206, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.299 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.206, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.206, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.299 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.155 2026-02-17T12:23:38.771 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:35 2026", 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.130, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.120, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.131 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.177, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.193, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.372 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.177, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.193, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.372 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.180 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:37 2026", 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.109, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.091, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.104 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.192, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.192, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.310 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.772 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.773 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.192, 2026-02-17T12:23:38.773 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.192, 2026-02-17T12:23:38.773 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.310 2026-02-17T12:23:38.773 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.773 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.132 2026-02-17T12:23:38.773 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:23:38.773 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:23:38.773 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:23:38.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:92: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:23:38.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:92: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:23:38.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:92: TEST_network_ping_test1: test 4 = 4 2026-02-17T12:23:38.777 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:93: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:23:38.777 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:93: TEST_network_ping_test1: jq .threshold 2026-02-17T12:23:38.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:93: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:23:38.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:23:38.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-17T12:23:38.781 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2026-02-17T12:23:38.781 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2026-02-17T12:23:38.781 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:23:38.781 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:38.781 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:38.781 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-mgr.x.asok 2026-02-17T12:23:38.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:23:38.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-mgr.x.asok dump_osd_network 0 2026-02-17T12:23:38.821 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:23:38.821 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 0, 2026-02-17T12:23:38.821 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [ 2026-02-17T12:23:38.821 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.821 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:34 2026", 2026-02-17T12:23:38.821 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.821 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:23:38.821 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:23:38.821 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:23:38.821 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.821 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.143, 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.132, 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.135 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.127, 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.104, 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.098 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.157, 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.208, 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.281 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.822 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.189 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:35 2026", 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.125, 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.131, 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.141 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.823 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.107, 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.101, 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.098 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.134, 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.203, 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.359 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.164 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:35 2026", 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.824 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.130, 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.120, 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.131 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.106, 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.090, 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.076 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.177, 2026-02-17T12:23:38.825 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.193, 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.372 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.155 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:34 2026", 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.109, 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.105, 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.120 2026-02-17T12:23:38.826 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.088, 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.077, 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.077 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.138, 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.152, 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.238 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.177 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.827 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:32 2026", 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.106, 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.119, 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.118 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.081, 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.081, 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.081 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.828 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.151, 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.151, 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.299 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.147 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:34 2026", 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.094, 2026-02-17T12:23:38.829 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.112, 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.117 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.072, 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.072, 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.072 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.130, 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.158, 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.226 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.149 2026-02-17T12:23:38.830 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:34 2026", 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.101, 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.115, 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.112 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.093, 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.089, 2026-02-17T12:23:38.831 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.085 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.111, 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.195, 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.195 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.112 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:34 2026", 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 2, 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:23:38.832 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.110, 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.105, 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.104 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.100, 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.075, 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.062 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.121, 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.159, 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.202 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.833 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.161 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:34 2026", 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 2, 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.099, 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.098, 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.104 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.070, 2026-02-17T12:23:38.834 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.070, 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.070 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.128, 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.130, 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.181 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.115 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:32 2026", 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 0, 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 1, 2026-02-17T12:23:38.835 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.078, 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.092, 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.102 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.065, 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.065, 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.062 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.101, 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.156, 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.310 2026-02-17T12:23:38.836 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.120 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:35 2026", 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "front", 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.078, 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.095, 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.096 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.837 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.070, 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.070, 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.065 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.089, 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.134, 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.166 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.086 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: "last update": "Tue Feb 17 12:23:35 2026", 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: "stale": false, 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: "from osd": 1, 2026-02-17T12:23:38.838 INFO:tasks.workunit.client.0.trial155.stdout: "to osd": 0, 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "interface": "back", 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "average": { 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.090, 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.090, 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.094 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "min": { 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.080, 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.063, 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.063 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "max": { 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "1min": 0.105, 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "5min": 0.155, 2026-02-17T12:23:38.839 INFO:tasks.workunit.client.0.trial155.stdout: "15min": 0.161 2026-02-17T12:23:38.840 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:23:38.840 INFO:tasks.workunit.client.0.trial155.stdout: "last": 0.099 2026-02-17T12:23:38.840 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:23:38.840 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:23:38.840 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:23:38.841 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:96: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:96: TEST_network_ping_test1: jq '.entries | length' 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:96: TEST_network_ping_test1: test 12 = 12 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:97: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:97: TEST_network_ping_test1: jq .threshold 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:97: TEST_network_ping_test1: test 0 = 0 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: get_asok_path mgr.x 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:38.842 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:38.843 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-mgr.x.asok 2026-02-17T12:23:38.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:23:38.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-mgr.x.asok dump_osd_network 99 2026-02-17T12:23:38.873 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:23:38.874 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 99, 2026-02-17T12:23:38.874 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [] 2026-02-17T12:23:38.874 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:23:38.879 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:101: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:23:38.879 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:101: TEST_network_ping_test1: jq .threshold 2026-02-17T12:23:38.882 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:101: TEST_network_ping_test1: test 99 = 99 2026-02-17T12:23:38.882 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: tee td/network-ping/json 2026-02-17T12:23:38.884 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: get_asok_path osd.0 2026-02-17T12:23:38.885 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:23:38.885 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:23:38.885 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:23:38.885 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:38.885 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:38.885 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-osd.0.asok 2026-02-17T12:23:38.886 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: CEPH_ARGS= 2026-02-17T12:23:38.886 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.51574/ceph-osd.0.asok dump_osd_network 98 2026-02-17T12:23:38.927 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:23:38.927 INFO:tasks.workunit.client.0.trial155.stdout: "threshold": 98, 2026-02-17T12:23:38.927 INFO:tasks.workunit.client.0.trial155.stdout: "entries": [] 2026-02-17T12:23:38.927 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:23:38.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:103: TEST_network_ping_test1: cat td/network-ping/json 2026-02-17T12:23:38.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:103: TEST_network_ping_test1: jq .threshold 2026-02-17T12:23:38.934 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:103: TEST_network_ping_test1: test 98 = 98 2026-02-17T12:23:38.934 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:105: TEST_network_ping_test1: rm -f td/network-ping/json 2026-02-17T12:23:38.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:20: run: teardown td/network-ping 2026-02-17T12:23:38.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/network-ping 2026-02-17T12:23:38.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:23:38.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/network-ping KILL 2026-02-17T12:23:38.936 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:23:38.937 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:23:38.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:23:38.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:23:38.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:23:39.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:23:39.042 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:23:39.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:23:39.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:23:39.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:23:39.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:23:39.044 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:23:39.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:23:39.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:23:39.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:23:39.046 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:23:39.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:23:39.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:23:39.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/network-ping 2026-02-17T12:23:39.657 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:23:39.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:39.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:39.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.51574 2026-02-17T12:23:39.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:23:39.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:23:39.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:17: run: for func in $funcs 2026-02-17T12:23:39.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:18: run: setup td/network-ping 2026-02-17T12:23:39.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/network-ping 2026-02-17T12:23:39.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/network-ping 2026-02-17T12:23:39.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/network-ping 2026-02-17T12:23:39.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:23:39.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/network-ping KILL 2026-02-17T12:23:39.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:23:39.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:23:39.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:23:39.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:23:39.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:23:39.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:23:39.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:23:39.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:23:39.662 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:23:39.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:23:39.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:23:39.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:23:39.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:23:39.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:23:39.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:23:39.665 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:23:39.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:23:39.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:23:39.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/network-ping 2026-02-17T12:23:39.667 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:23:39.667 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:39.667 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:39.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.51574 2026-02-17T12:23:39.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:23:39.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:23:39.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/network-ping 2026-02-17T12:23:39.669 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:23:39.669 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:39.669 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:39.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.51574 2026-02-17T12:23:39.670 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:23:39.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:23:39.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:23:39.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/network-ping 1' TERM HUP INT 2026-02-17T12:23:39.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:19: run: TEST_network_ping_test2 td/network-ping 2026-02-17T12:23:39.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:111: TEST_network_ping_test2: local dir=td/network-ping 2026-02-17T12:23:39.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:113: TEST_network_ping_test2: export CEPH_ARGS 2026-02-17T12:23:39.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:114: TEST_network_ping_test2: export 'EXTRA_OPTS= --mon_warn_on_slow_ping_time=0.001' 2026-02-17T12:23:39.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:114: TEST_network_ping_test2: EXTRA_OPTS=' --mon_warn_on_slow_ping_time=0.001' 2026-02-17T12:23:39.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:115: TEST_network_ping_test2: run_mon td/network-ping a 2026-02-17T12:23:39.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/network-ping 2026-02-17T12:23:39.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:23:39.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:23:39.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:23:39.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/network-ping/a 2026-02-17T12:23:39.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/network-ping/a --run-dir=td/network-ping 2026-02-17T12:23:39.692 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:23:39.692 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:23:39.692 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:23:39.692 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:23:39.692 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:39.692 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:39.692 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:23:39.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --mon_warn_on_slow_ping_time=0.001 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/network-ping/a '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --mon-cluster-log-file=td/network-ping/log --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:23:39.717 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:23:39.718 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:23:39.718 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:23:39.718 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:23:39.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:23:39.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:23:39.720 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:23:39.720 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:23:39.720 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:23:39.720 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:23:39.720 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:39.720 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:39.720 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-mon.a.asok 2026-02-17T12:23:39.720 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:23:39.721 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.51574/ceph-mon.a.asok config get fsid 2026-02-17T12:23:39.764 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:23:39.765 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:23:39.765 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:23:39.765 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:23:39.765 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:23:39.765 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:23:39.765 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:23:39.765 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:23:39.766 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:23:39.766 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:39.766 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:39.766 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.51574/ceph-mon.a.asok 2026-02-17T12:23:39.766 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:23:39.767 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.51574/ceph-mon.a.asok config get mon_host 2026-02-17T12:23:39.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:116: TEST_network_ping_test2: run_mgr td/network-ping x 2026-02-17T12:23:39.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/network-ping 2026-02-17T12:23:39.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:23:39.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:23:39.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:23:39.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/network-ping/x 2026-02-17T12:23:39.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:23:39.907 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:23:39.908 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:23:39.908 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:23:39.908 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:23:39.908 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:39.908 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:39.908 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:23:39.908 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:23:39.909 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --mon_warn_on_slow_ping_time=0.001 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/network-ping/x '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:23:39.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:117: TEST_network_ping_test2: run_osd td/network-ping 0 2026-02-17T12:23:39.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/network-ping 2026-02-17T12:23:39.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:23:39.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:23:39.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:23:39.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/network-ping/0 2026-02-17T12:23:39.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/network-ping/0' 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/network-ping/0/journal' 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --mon_warn_on_slow_ping_time=0.001' 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:23:39.930 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:23:39.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:23:39.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:23:39.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:23:39.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:23:39.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/network-ping/0 2026-02-17T12:23:39.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:23:39.933 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=61b1bbbe-2d60-4201-bf52-7bc32197a420 2026-02-17T12:23:39.933 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 61b1bbbe-2d60-4201-bf52-7bc32197a420' 2026-02-17T12:23:39.933 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 61b1bbbe-2d60-4201-bf52-7bc32197a420 2026-02-17T12:23:39.933 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:23:39.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDLXZRponkJOBAATmXXcEAueVRtdqdjGAYl6w== 2026-02-17T12:23:39.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDLXZRponkJOBAATmXXcEAueVRtdqdjGAYl6w=="}' 2026-02-17T12:23:39.942 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 61b1bbbe-2d60-4201-bf52-7bc32197a420 -i td/network-ping/0/new.json 2026-02-17T12:23:40.045 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:23:40.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/network-ping/0/new.json 2026-02-17T12:23:40.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDLXZRponkJOBAATmXXcEAueVRtdqdjGAYl6w== --osd-uuid 61b1bbbe-2d60-4201-bf52-7bc32197a420 2026-02-17T12:23:40.070 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:40.069+0000 7ff134a13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:40.072 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:40.070+0000 7ff134a13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:40.073 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:40.071+0000 7ff134a13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:40.073 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:40.072+0000 7ff134a13780 -1 bdev(0x5628cba17c00 td/network-ping/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:23:40.073 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:40.072+0000 7ff134a13780 -1 bluestore(td/network-ping/0) _read_fsid unparsable uuid 2026-02-17T12:23:42.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/network-ping/0/keyring 2026-02-17T12:23:42.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:23:42.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:23:42.736 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:23:42.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/network-ping/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:23:42.990 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:23:42.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:23:42.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:23:42.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:23:42.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:23:42.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:23:43.006 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:43.004+0000 7fb76e520780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:43.007 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:43.006+0000 7fb76e520780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:43.008 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:43.007+0000 7fb76e520780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:43.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:23:43.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:23:43.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:23:43.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:23:43.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:23:43.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:23:43.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:23:43.186 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:23:43.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:23:43.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:23:43.381 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:23:44.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:23:44.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:23:44.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:23:44.383 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:23:44.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:23:44.384 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:23:44.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:23:44.848 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:44.846+0000 7fb76e520780 -1 Falling back to public interface 2026-02-17T12:23:45.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:23:45.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:23:45.571 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:23:45.571 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:23:45.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:23:45.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:23:45.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:23:46.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:23:46.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:23:46.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:23:46.760 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:23:46.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:23:46.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:23:46.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:23:47.560 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:47.559+0000 7fb76e520780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:23:47.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:23:47.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:23:47.954 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:23:47.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:23:47.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:23:47.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:23:48.144 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:23:49.145 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:23:49.146 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:23:49.146 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:23:49.146 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:23:49.147 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:23:49.147 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:23:49.336 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2292523044,v1:127.0.0.1:6803/2292523044] [v2:127.0.0.1:6804/2292523044,v1:127.0.0.1:6805/2292523044] exists,up 61b1bbbe-2d60-4201-bf52-7bc32197a420 2026-02-17T12:23:49.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:23:49.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:23:49.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:23:49.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:118: TEST_network_ping_test2: run_osd td/network-ping 1 2026-02-17T12:23:49.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/network-ping 2026-02-17T12:23:49.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:23:49.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:23:49.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:23:49.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/network-ping/1 2026-02-17T12:23:49.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-17T12:23:49.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:23:49.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:23:49.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/network-ping/1' 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/network-ping/1/journal' 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --mon_warn_on_slow_ping_time=0.001' 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:23:49.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:23:49.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/network-ping/1 2026-02-17T12:23:49.343 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:23:49.343 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4967d702-17b3-41de-83b4-85e64e7e341b 2026-02-17T12:23:49.343 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 4967d702-17b3-41de-83b4-85e64e7e341b 2026-02-17T12:23:49.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 4967d702-17b3-41de-83b4-85e64e7e341b' 2026-02-17T12:23:49.344 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:23:49.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDVXZRp9VzZFBAAonMt5fAHtQ+WLsVIg1oQsw== 2026-02-17T12:23:49.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDVXZRp9VzZFBAAonMt5fAHtQ+WLsVIg1oQsw=="}' 2026-02-17T12:23:49.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4967d702-17b3-41de-83b4-85e64e7e341b -i td/network-ping/1/new.json 2026-02-17T12:23:49.542 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:23:49.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/network-ping/1/new.json 2026-02-17T12:23:49.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDVXZRp9VzZFBAAonMt5fAHtQ+WLsVIg1oQsw== --osd-uuid 4967d702-17b3-41de-83b4-85e64e7e341b 2026-02-17T12:23:49.569 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:49.567+0000 7fd98900e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:49.570 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:49.569+0000 7fd98900e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:49.571 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:49.570+0000 7fd98900e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:49.572 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:49.570+0000 7fd98900e780 -1 bdev(0x563e0a009c00 td/network-ping/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:23:49.572 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:49.570+0000 7fd98900e780 -1 bluestore(td/network-ping/1) _read_fsid unparsable uuid 2026-02-17T12:23:51.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/network-ping/1/keyring 2026-02-17T12:23:51.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:23:51.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:23:51.692 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:23:51.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/network-ping/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:23:51.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:23:51.945 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:23:51.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:23:51.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:23:51.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:23:51.946 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:23:51.963 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:51.962+0000 7fb4df18f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:51.964 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:51.963+0000 7fb4df18f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:51.965 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:51.964+0000 7fb4df18f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:52.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:23:52.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:23:52.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:23:52.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:23:52.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:23:52.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:23:52.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:23:52.135 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:23:52.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:23:52.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:23:52.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:23:53.301 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:53.300+0000 7fb4df18f780 -1 Falling back to public interface 2026-02-17T12:23:53.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:23:53.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:23:53.326 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:23:53.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:23:53.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:23:53.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:23:53.513 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:23:54.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:23:54.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:23:54.514 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:23:54.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:23:54.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:23:54.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:23:54.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:23:55.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:23:55.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:23:55.702 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:23:55.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:23:55.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:23:55.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:23:55.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:23:56.021 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:56.019+0000 7fb4df18f780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:23:56.891 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:23:56.891 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:23:56.891 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:23:56.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:23:56.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:23:56.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:23:57.078 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/967792298,v1:127.0.0.1:6811/967792298] [v2:127.0.0.1:6812/967792298,v1:127.0.0.1:6813/967792298] exists,up 4967d702-17b3-41de-83b4-85e64e7e341b 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:119: TEST_network_ping_test2: run_osd td/network-ping 2 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/network-ping 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/network-ping/2 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/network-ping/2' 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/network-ping/2/journal' 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:23:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --mon_warn_on_slow_ping_time=0.001' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/network-ping' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:23:57.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:23:57.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:23:57.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:23:57.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:23:57.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/network-ping/2 2026-02-17T12:23:57.081 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:23:57.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=5db9583d-b3c3-43c1-b665-f2e659c636c4 2026-02-17T12:23:57.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 5db9583d-b3c3-43c1-b665-f2e659c636c4' 2026-02-17T12:23:57.082 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 5db9583d-b3c3-43c1-b665-f2e659c636c4 2026-02-17T12:23:57.082 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:23:57.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDdXZRpg06PBRAABS0ECebkiMBUy6BBf2zlWA== 2026-02-17T12:23:57.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDdXZRpg06PBRAABS0ECebkiMBUy6BBf2zlWA=="}' 2026-02-17T12:23:57.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 5db9583d-b3c3-43c1-b665-f2e659c636c4 -i td/network-ping/2/new.json 2026-02-17T12:23:57.285 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:23:57.292 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/network-ping/2/new.json 2026-02-17T12:23:57.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDdXZRpg06PBRAABS0ECebkiMBUy6BBf2zlWA== --osd-uuid 5db9583d-b3c3-43c1-b665-f2e659c636c4 2026-02-17T12:23:57.314 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:57.312+0000 7f8c9a02d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:57.315 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:57.314+0000 7f8c9a02d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:57.316 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:57.315+0000 7f8c9a02d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:57.317 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:57.315+0000 7f8c9a02d780 -1 bdev(0x55b1a6a37c00 td/network-ping/2/block) open stat got: (1) Operation not permitted 2026-02-17T12:23:57.317 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:57.315+0000 7f8c9a02d780 -1 bluestore(td/network-ping/2) _read_fsid unparsable uuid 2026-02-17T12:23:59.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/network-ping/2/keyring 2026-02-17T12:23:59.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:23:59.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:23:59.679 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:23:59.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/network-ping/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:23:59.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:23:59.937 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:23:59.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=c60413e1-3a7c-4dcc-9792-684343b41df3 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.51574/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:23:59.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:23:59.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:23:59.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:23:59.953 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:59.952+0000 7fef76c14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:59.955 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:59.953+0000 7fef76c14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:23:59.955 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:23:59.954+0000 7fef76c14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:24:00.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:24:00.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:24:00.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:24:00.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:24:00.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:24:00.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:00.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:24:00.126 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:24:00.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:00.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:24:00.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:24:01.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:24:01.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:01.313 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:24:01.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:24:01.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:01.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:24:01.499 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:24:01.550 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:01.548+0000 7fef76c14780 -1 Falling back to public interface 2026-02-17T12:24:02.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:24:02.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:02.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:24:02.501 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:24:02.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:02.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:24:02.688 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:24:03.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:24:03.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:03.689 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:24:03.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:24:03.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:03.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:24:03.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:24:04.753 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:04.751+0000 7fef76c14780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:24:04.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:24:04.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:04.879 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:24:04.879 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:24:04.880 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:04.880 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:24:05.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:24:06.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:24:06.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:06.072 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:24:06.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:24:06.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:06.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:24:06.260 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/953010859,v1:127.0.0.1:6819/953010859] [v2:127.0.0.1:6820/953010859,v1:127.0.0.1:6821/953010859] exists,up 5db9583d-b3c3-43c1-b665-f2e659c636c4 2026-02-17T12:24:06.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:24:06.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:24:06.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:24:06.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:121: TEST_network_ping_test2: sleep 5 2026-02-17T12:24:11.262 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:122: TEST_network_ping_test2: ceph osd crush add-bucket dc1 datacenter 2026-02-17T12:24:11.499 INFO:tasks.workunit.client.0.trial155.stderr:bucket 'dc1' already exists 2026-02-17T12:24:11.507 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:123: TEST_network_ping_test2: ceph osd crush add-bucket dc2 datacenter 2026-02-17T12:24:11.704 INFO:tasks.workunit.client.0.trial155.stderr:bucket 'dc2' already exists 2026-02-17T12:24:11.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:124: TEST_network_ping_test2: ceph osd crush add-bucket dc3 datacenter 2026-02-17T12:24:11.907 INFO:tasks.workunit.client.0.trial155.stderr:bucket 'dc3' already exists 2026-02-17T12:24:11.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:125: TEST_network_ping_test2: ceph osd crush add-bucket rack1 rack 2026-02-17T12:24:12.110 INFO:tasks.workunit.client.0.trial155.stderr:bucket 'rack1' already exists 2026-02-17T12:24:12.118 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:126: TEST_network_ping_test2: ceph osd crush add-bucket rack2 rack 2026-02-17T12:24:12.312 INFO:tasks.workunit.client.0.trial155.stderr:bucket 'rack2' already exists 2026-02-17T12:24:12.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:127: TEST_network_ping_test2: ceph osd crush add-bucket rack3 rack 2026-02-17T12:24:12.514 INFO:tasks.workunit.client.0.trial155.stderr:bucket 'rack3' already exists 2026-02-17T12:24:12.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:128: TEST_network_ping_test2: ceph osd crush add-bucket host1 host 2026-02-17T12:24:12.718 INFO:tasks.workunit.client.0.trial155.stderr:bucket 'host1' already exists 2026-02-17T12:24:12.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:129: TEST_network_ping_test2: ceph osd crush add-bucket host2 host 2026-02-17T12:24:12.919 INFO:tasks.workunit.client.0.trial155.stderr:bucket 'host2' already exists 2026-02-17T12:24:12.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:130: TEST_network_ping_test2: ceph osd crush add-bucket host3 host 2026-02-17T12:24:13.122 INFO:tasks.workunit.client.0.trial155.stderr:bucket 'host3' already exists 2026-02-17T12:24:13.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:131: TEST_network_ping_test2: ceph osd crush move dc1 root=default 2026-02-17T12:24:13.324 INFO:tasks.workunit.client.0.trial155.stderr:no need to move item id -5 name 'dc1' to location {root=default} in crush map 2026-02-17T12:24:13.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:132: TEST_network_ping_test2: ceph osd crush move dc2 root=default 2026-02-17T12:24:13.528 INFO:tasks.workunit.client.0.trial155.stderr:no need to move item id -6 name 'dc2' to location {root=default} in crush map 2026-02-17T12:24:13.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:133: TEST_network_ping_test2: ceph osd crush move dc3 root=default 2026-02-17T12:24:13.731 INFO:tasks.workunit.client.0.trial155.stderr:no need to move item id -7 name 'dc3' to location {root=default} in crush map 2026-02-17T12:24:13.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:134: TEST_network_ping_test2: ceph osd crush move rack1 datacenter=dc1 2026-02-17T12:24:13.933 INFO:tasks.workunit.client.0.trial155.stderr:no need to move item id -8 name 'rack1' to location {datacenter=dc1} in crush map 2026-02-17T12:24:13.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:135: TEST_network_ping_test2: ceph osd crush move rack2 datacenter=dc2 2026-02-17T12:24:14.137 INFO:tasks.workunit.client.0.trial155.stderr:no need to move item id -9 name 'rack2' to location {datacenter=dc2} in crush map 2026-02-17T12:24:14.144 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:136: TEST_network_ping_test2: ceph osd crush move rack3 datacenter=dc3 2026-02-17T12:24:14.339 INFO:tasks.workunit.client.0.trial155.stderr:no need to move item id -10 name 'rack3' to location {datacenter=dc3} in crush map 2026-02-17T12:24:14.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:137: TEST_network_ping_test2: ceph osd crush move host1 rack=rack1 2026-02-17T12:24:14.542 INFO:tasks.workunit.client.0.trial155.stderr:no need to move item id -11 name 'host1' to location {rack=rack1} in crush map 2026-02-17T12:24:14.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:138: TEST_network_ping_test2: ceph osd crush move host2 rack=rack2 2026-02-17T12:24:14.743 INFO:tasks.workunit.client.0.trial155.stderr:no need to move item id -12 name 'host2' to location {rack=rack2} in crush map 2026-02-17T12:24:14.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:139: TEST_network_ping_test2: ceph osd crush move host3 rack=rack3 2026-02-17T12:24:14.947 INFO:tasks.workunit.client.0.trial155.stderr:no need to move item id -13 name 'host3' to location {rack=rack3} in crush map 2026-02-17T12:24:14.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:140: TEST_network_ping_test2: ceph osd crush set osd.0 1.0 host=host1 2026-02-17T12:24:15.149 INFO:tasks.workunit.client.0.trial155.stderr:set item id 0 name 'osd.0' weight 1 at location {host=host1}: no change 2026-02-17T12:24:15.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:141: TEST_network_ping_test2: ceph osd crush set osd.1 1.0 host=host2 2026-02-17T12:24:15.350 INFO:tasks.workunit.client.0.trial155.stderr:set item id 1 name 'osd.1' weight 1 at location {host=host2}: no change 2026-02-17T12:24:15.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:142: TEST_network_ping_test2: ceph osd crush set osd.2 1.0 host=host3 2026-02-17T12:24:15.553 INFO:tasks.workunit.client.0.trial155.stderr:set item id 2 name 'osd.2' weight 1 at location {host=host3}: no change 2026-02-17T12:24:15.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:143: TEST_network_ping_test2: ceph osd crush rule create-simple myrule default host firstn 2026-02-17T12:24:15.756 INFO:tasks.workunit.client.0.trial155.stderr:rule myrule already exists 2026-02-17T12:24:15.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:145: TEST_network_ping_test2: create_pool foo 16 16 replicated myrule 2026-02-17T12:24:15.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create foo 16 16 replicated myrule 2026-02-17T12:24:15.958 INFO:tasks.workunit.client.0.trial155.stderr:pool 'foo' already exists 2026-02-17T12:24:15.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:24:16.967 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:148: TEST_network_ping_test2: timeout 20 rados bench -p foo 10 write -b 4096 --no-cleanup 2026-02-17T12:24:16.990 INFO:tasks.workunit.client.0.trial155.stdout:hints = 1 2026-02-17T12:24:16.990 INFO:tasks.workunit.client.0.trial155.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 10 seconds or 0 objects 2026-02-17T12:24:16.991 INFO:tasks.workunit.client.0.trial155.stdout:Object prefix: benchmark_data_trial155_62503 2026-02-17T12:24:16.991 INFO:tasks.workunit.client.0.trial155.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T12:24:16.991 INFO:tasks.workunit.client.0.trial155.stdout: 0 0 0 0 0 0 - 0 2026-02-17T12:24:17.990 INFO:tasks.workunit.client.0.trial155.stdout: 1 16 11046 11030 43.0825 43.0859 0.00105215 0.00144827 2026-02-17T12:24:18.990 INFO:tasks.workunit.client.0.trial155.stdout: 2 16 22625 22609 44.1547 45.2305 0.00120073 0.00141361 2026-02-17T12:24:19.990 INFO:tasks.workunit.client.0.trial155.stdout: 3 16 34468 34452 44.8558 46.2617 0.00157207 0.00139173 2026-02-17T12:24:20.990 INFO:tasks.workunit.client.0.trial155.stdout: 4 16 46416 46400 45.3088 46.6719 0.00105455 0.00137782 2026-02-17T12:24:21.991 INFO:tasks.workunit.client.0.trial155.stdout: 5 16 58282 58266 45.5166 46.3516 0.000853919 0.00137165 2026-02-17T12:24:22.990 INFO:tasks.workunit.client.0.trial155.stdout: 6 16 70380 70364 45.8062 47.2578 0.00147877 0.00136301 2026-02-17T12:24:23.991 INFO:tasks.workunit.client.0.trial155.stdout: 7 16 82614 82598 46.089 47.7891 0.00124777 0.0013546 2026-02-17T12:24:24.991 INFO:tasks.workunit.client.0.trial155.stdout: 8 16 92354 92338 45.0833 38.0469 0.00183744 0.00138491 2026-02-17T12:24:25.991 INFO:tasks.workunit.client.0.trial155.stdout: 9 16 101977 101961 44.2502 37.5898 0.00164029 0.00141093 2026-02-17T12:24:26.991 INFO:tasks.workunit.client.0.trial155.stdout: 10 3 111472 111469 43.539 37.1406 0.00122175 0.00143413 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Total time run: 10.001 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Total writes made: 111472 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Write size: 4096 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Object size: 4096 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Bandwidth (MB/sec): 43.5393 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Stddev Bandwidth: 4.30236 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Max bandwidth (MB/sec): 47.7891 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Min bandwidth (MB/sec): 37.1406 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Average IOPS: 11146 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Stddev IOPS: 1101.4 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Max IOPS: 12234 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Min IOPS: 9508 2026-02-17T12:24:27.991 INFO:tasks.workunit.client.0.trial155.stdout:Average Latency(s): 0.00143413 2026-02-17T12:24:27.992 INFO:tasks.workunit.client.0.trial155.stdout:Stddev Latency(s): 0.000645016 2026-02-17T12:24:27.992 INFO:tasks.workunit.client.0.trial155.stdout:Max latency(s): 0.0127069 2026-02-17T12:24:27.992 INFO:tasks.workunit.client.0.trial155.stdout:Min latency(s): 0.000422361 2026-02-17T12:24:27.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:151: TEST_network_ping_test2: sleep 10 2026-02-17T12:24:37.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:152: TEST_network_ping_test2: flush_pg_stats 2026-02-17T12:24:37.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:24:37.999 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:24:38.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:24:38.186 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:24:38.186 INFO:tasks.workunit.client.0.trial155.stderr:2' 2026-02-17T12:24:38.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:24:38.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:24:38.186 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:24:38.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836492 2026-02-17T12:24:38.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836492 2026-02-17T12:24:38.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T12:24:38.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:24:38.249 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:24:38.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672972 2026-02-17T12:24:38.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672972 2026-02-17T12:24:38.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492 1-42949672972' 2026-02-17T12:24:38.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:24:38.312 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:24:38.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542153 2026-02-17T12:24:38.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542153 2026-02-17T12:24:38.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492 1-42949672972 2-60129542153' 2026-02-17T12:24:38.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:24:38.373 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836492 2026-02-17T12:24:38.373 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:24:38.374 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:24:38.375 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836492 2026-02-17T12:24:38.375 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:24:38.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836492 2026-02-17T12:24:38.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T12:24:38.376 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836492 2026-02-17T12:24:38.376 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:24:38.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836490 -lt 21474836492 2026-02-17T12:24:38.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:24:39.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:24:39.564 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:24:39.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836490 -lt 21474836492 2026-02-17T12:24:39.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:24:40.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:24:40.753 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:24:40.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836493 -lt 21474836492 2026-02-17T12:24:40.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:24:40.936 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672972 2026-02-17T12:24:40.937 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:24:40.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:24:40.938 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672972 2026-02-17T12:24:40.938 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:24:40.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672972 2026-02-17T12:24:40.939 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 42949672972 2026-02-17T12:24:40.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672972' 2026-02-17T12:24:40.940 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:24:41.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672972 -lt 42949672972 2026-02-17T12:24:41.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:24:41.128 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542153 2026-02-17T12:24:41.128 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:24:41.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:24:41.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542153 2026-02-17T12:24:41.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:24:41.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542153 2026-02-17T12:24:41.130 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 60129542153 2026-02-17T12:24:41.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T12:24:41.131 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:24:41.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T12:24:41.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:154: TEST_network_ping_test2: ceph health 2026-02-17T12:24:41.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:154: TEST_network_ping_test2: tee td/network-ping/health 2026-02-17T12:24:41.538 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN Slow OSD heartbeats on back (longest 0.249ms); Slow OSD heartbeats on front (longest 0.246ms); 1 pool(s) do not have an application enabled 2026-02-17T12:24:41.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:155: TEST_network_ping_test2: grep -q 'Slow OSD heartbeats' td/network-ping/health 2026-02-17T12:24:41.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:157: TEST_network_ping_test2: ceph health detail 2026-02-17T12:24:41.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:157: TEST_network_ping_test2: tee td/network-ping/health 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN Slow OSD heartbeats on back (longest 0.249ms); Slow OSD heartbeats on front (longest 0.246ms); 1 pool(s) do not have an application enabled 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_SLOW_PING_TIME_BACK: Slow OSD heartbeats on back (longest 0.249ms) 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on back from osd.0 [dc1,rack1] to osd.2 [dc3,rack3] 0.249 msec 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on back from osd.0 [dc1,rack1] to osd.1 [dc2,rack2] 0.181 msec possibly improving 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on back from osd.2 [dc3,rack3] to osd.1 [dc2,rack2] 0.164 msec 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on back from osd.1 [dc2,rack2] to osd.2 [dc3,rack3] 0.164 msec possibly improving 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on back from osd.2 [dc3,rack3] to osd.0 [dc1,rack1] 0.163 msec 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on back from osd.1 [dc2,rack2] to osd.0 [dc1,rack1] 0.140 msec 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_SLOW_PING_TIME_FRONT: Slow OSD heartbeats on front (longest 0.246ms) 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on front from osd.0 [dc1,rack1] to osd.1 [dc2,rack2] 0.246 msec 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on front from osd.0 [dc1,rack1] to osd.2 [dc3,rack3] 0.229 msec 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on front from osd.2 [dc3,rack3] to osd.1 [dc2,rack2] 0.177 msec 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on front from osd.1 [dc2,rack2] to osd.2 [dc3,rack3] 0.176 msec 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on front from osd.2 [dc3,rack3] to osd.0 [dc1,rack1] 0.163 msec 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: Slow OSD heartbeats on front from osd.1 [dc2,rack2] to osd.0 [dc1,rack1] 0.153 msec 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: application not enabled on pool 'foo' 2026-02-17T12:24:41.801 INFO:tasks.workunit.client.0.trial155.stdout: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2026-02-17T12:24:41.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:158: TEST_network_ping_test2: grep -q OSD_SLOW_PING_TIME_BACK td/network-ping/health 2026-02-17T12:24:41.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:159: TEST_network_ping_test2: grep -q OSD_SLOW_PING_TIME_FRONT td/network-ping/health 2026-02-17T12:24:41.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:160: TEST_network_ping_test2: grep -q 'Slow OSD heartbeats on front from osd[.][0-2] [[]dc[1-3],rack[1-3][]] to osd[.][0-2] [[]dc[1-3],rack[1-3][]]' td/network-ping/health 2026-02-17T12:24:41.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:162: TEST_network_ping_test2: rm -f td/network-ping/health 2026-02-17T12:24:41.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:20: run: teardown td/network-ping 2026-02-17T12:24:41.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/network-ping 2026-02-17T12:24:41.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:24:41.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/network-ping KILL 2026-02-17T12:24:41.812 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:24:41.812 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:24:41.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:24:41.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:24:41.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:24:41.919 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:24:41.920 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:24:41.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:24:41.921 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:24:41.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:24:41.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:24:41.922 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:24:41.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:24:41.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:24:41.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:24:41.923 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:24:41.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:24:41.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:24:41.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/network-ping 2026-02-17T12:24:42.650 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:24:42.651 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:24:42.651 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:24:42.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.51574 2026-02-17T12:24:42.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:24:42.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:24:42.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T12:24:42.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/network-ping 0 2026-02-17T12:24:42.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/network-ping 2026-02-17T12:24:42.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T12:24:42.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/network-ping KILL 2026-02-17T12:24:42.653 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:24:42.653 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:24:42.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:24:42.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:24:42.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:24:42.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:24:42.654 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:24:42.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:24:42.655 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:24:42.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:24:42.656 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:24:42.656 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:24:42.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:24:42.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:24:42.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:24:42.657 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:24:42.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:24:42.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T12:24:42.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/network-ping 2026-02-17T12:24:42.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:24:42.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:24:42.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.51574 2026-02-17T12:24:42.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.51574 2026-02-17T12:24:42.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:24:42.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:24:42.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T12:24:42.662 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T12:24:42.663 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T12:24:42.730 INFO:tasks.workunit:Running workunit misc/ok-to-stop.sh... 2026-02-17T12:24:42.730 DEBUG:teuthology.orchestra.run.trial155:workunit test misc/ok-to-stop.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c96dfb3f50b3d02598a82af7104764bfdcd3919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh 2026-02-17T12:24:42.792 INFO:tasks.workunit.client.0.trial155.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/ok-to-stop 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:6: run: local dir=td/ok-to-stop 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:7: run: shift 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:9: run: export CEPH_MON_A=127.0.0.1:7150 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:9: run: CEPH_MON_A=127.0.0.1:7150 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:10: run: export CEPH_MON_B=127.0.0.1:7151 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:10: run: CEPH_MON_B=127.0.0.1:7151 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:11: run: export CEPH_MON_C=127.0.0.1:7152 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:11: run: CEPH_MON_C=127.0.0.1:7152 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:12: run: export CEPH_MON_D=127.0.0.1:7153 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:12: run: CEPH_MON_D=127.0.0.1:7153 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:13: run: export CEPH_MON_E=127.0.0.1:7154 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:13: run: CEPH_MON_E=127.0.0.1:7154 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:14: run: export CEPH_ARGS 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:15: run: uuidgen 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:15: run: CEPH_ARGS+='--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none ' 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:16: run: export 'ORIG_CEPH_ARGS=--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none ' 2026-02-17T12:24:42.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:16: run: ORIG_CEPH_ARGS='--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none ' 2026-02-17T12:24:42.797 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:18: run: set 2026-02-17T12:24:42.797 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T12:24:42.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:18: run: local 'funcs=TEST_0_mds 2026-02-17T12:24:42.798 INFO:tasks.workunit.client.0.trial155.stderr:TEST_0_osd 2026-02-17T12:24:42.798 INFO:tasks.workunit.client.0.trial155.stderr:TEST_1_mon_checks 2026-02-17T12:24:42.798 INFO:tasks.workunit.client.0.trial155.stderr:TEST_2_mons_checks 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:TEST_3_mons_checks 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:TEST_4_mons_checks 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:TEST_5_mons_checks' 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:24:42.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:24:42.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:24:42.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:24:42.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:24:42.802 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:24:42.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:24:42.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:24:42.803 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:24:42.803 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:24:42.803 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:24:42.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:24:42.804 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:24:42.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:24:42.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:24:42.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:24:42.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:24:42.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:24:42.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:24:42.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:24:42.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:24:42.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:24:42.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2026-02-17T12:24:42.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:24:42.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:24:42.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:24:42.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.62907 2026-02-17T12:24:42.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_0_mds td/ok-to-stop 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:208: TEST_0_mds: local dir=td/ok-to-stop 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:210: TEST_0_mds: CEPH_ARGS='--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:212: TEST_0_mds: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2026-02-17T12:24:42.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-17T12:24:42.829 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:24:42.829 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:24:42.829 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:24:42.830 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:24:42.830 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:24:42.830 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:24:42.830 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:24:42.830 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-17T12:24:42.855 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:24:42.856 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:24:42.856 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:24:42.856 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:24:42.856 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:24:42.856 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:24:42.856 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:24:42.857 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:24:42.857 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:24:42.857 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:24:42.857 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:24:42.857 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:24:42.857 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:24:42.857 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:24:42.857 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get fsid 2026-02-17T12:24:42.902 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:24:42.903 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:24:42.903 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:24:42.903 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:24:42.903 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:24:42.903 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:24:42.903 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:24:42.903 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:24:42.903 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:24:42.903 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:24:42.903 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:24:42.903 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:24:42.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:24:42.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get mon_host 2026-02-17T12:24:42.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:213: TEST_0_mds: run_mgr td/ok-to-stop x 2026-02-17T12:24:42.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ok-to-stop 2026-02-17T12:24:42.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:24:42.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:24:42.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:24:42.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ok-to-stop/x 2026-02-17T12:24:42.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:24:43.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:24:43.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:24:43.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:24:43.043 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:24:43.043 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:24:43.043 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:24:43.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:24:43.044 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:24:43.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ok-to-stop/x '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:24:43.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:214: TEST_0_mds: run_osd td/ok-to-stop 0 2026-02-17T12:24:43.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ok-to-stop 2026-02-17T12:24:43.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:24:43.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:24:43.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:24:43.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ok-to-stop/0 2026-02-17T12:24:43.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-17T12:24:43.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:24:43.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:24:43.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:24:43.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/0' 2026-02-17T12:24:43.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/0/journal' 2026-02-17T12:24:43.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:24:43.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:24:43.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:24:43.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2026-02-17T12:24:43.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2026-02-17T12:24:43.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:24:43.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:24:43.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:24:43.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:24:43.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:24:43.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:24:43.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ok-to-stop/0 2026-02-17T12:24:43.067 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:24:43.068 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b66dc96e-d6c9-43f6-b731-5b2868fc8010 2026-02-17T12:24:43.068 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 b66dc96e-d6c9-43f6-b731-5b2868fc8010' 2026-02-17T12:24:43.069 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 b66dc96e-d6c9-43f6-b731-5b2868fc8010 2026-02-17T12:24:43.069 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:24:43.077 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQALXpRp+89/BBAAEtrNQsoHyC30Cu39hHP7vw== 2026-02-17T12:24:43.078 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQALXpRp+89/BBAAEtrNQsoHyC30Cu39hHP7vw=="}' 2026-02-17T12:24:43.078 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b66dc96e-d6c9-43f6-b731-5b2868fc8010 -i td/ok-to-stop/0/new.json 2026-02-17T12:24:43.181 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:24:43.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ok-to-stop/0/new.json 2026-02-17T12:24:43.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQALXpRp+89/BBAAEtrNQsoHyC30Cu39hHP7vw== --osd-uuid b66dc96e-d6c9-43f6-b731-5b2868fc8010 2026-02-17T12:24:43.206 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:43.203+0000 7fac3b818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:24:43.207 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:43.205+0000 7fac3b818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:24:43.208 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:43.206+0000 7fac3b818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:24:43.209 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:43.206+0000 7fac3b818780 -1 bdev(0x560155947c00 td/ok-to-stop/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:24:43.209 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:43.206+0000 7fac3b818780 -1 bluestore(td/ok-to-stop/0) _read_fsid unparsable uuid 2026-02-17T12:24:46.091 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ok-to-stop/0/keyring 2026-02-17T12:24:46.091 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:24:46.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:24:46.092 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:24:46.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ok-to-stop/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:24:46.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:24:46.345 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:24:46.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:24:46.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:24:46.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:24:46.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:24:46.362 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:46.359+0000 7f0ec12fe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:24:46.363 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:46.361+0000 7f0ec12fe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:24:46.364 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:46.362+0000 7f0ec12fe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:24:46.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:24:46.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:24:46.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:24:46.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:24:46.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:24:46.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:46.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:24:46.535 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:24:46.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:46.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:24:46.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:24:47.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:24:47.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:47.727 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:24:47.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:24:47.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:47.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:24:47.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:24:47.948 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:47.945+0000 7f0ec12fe780 -1 Falling back to public interface 2026-02-17T12:24:48.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:24:48.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:48.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:24:48.917 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:24:48.918 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:48.918 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:24:49.110 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:24:50.111 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:24:50.111 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:50.111 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:24:50.111 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:24:50.112 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:50.112 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:24:50.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:24:50.893 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:24:50.891+0000 7f0ec12fe780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:24:51.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:24:51.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:51.301 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:24:51.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:24:51.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:51.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:24:51.494 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:24:52.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:24:52.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:24:52.495 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:24:52.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:24:52.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:24:52.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:24:52.682 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1185394469,v1:127.0.0.1:6803/1185394469] [v2:127.0.0.1:6804/1185394469,v1:127.0.0.1:6805/1185394469] exists,up b66dc96e-d6c9-43f6-b731-5b2868fc8010 2026-02-17T12:24:52.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:24:52.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:215: TEST_0_mds: run_mds td/ok-to-stop a 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:579: run_mds: local dir=td/ok-to-stop 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:580: run_mds: shift 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:581: run_mds: local id=a 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:582: run_mds: shift 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:583: run_mds: local data=td/ok-to-stop/a 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:586: run_mds: get_asok_path 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:24:52.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:586: run_mds: ceph-mds --id a --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' 2026-02-17T12:24:52.699 INFO:tasks.workunit.client.0.trial155.stdout:starting mds.a at 2026-02-17T12:24:52.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:217: TEST_0_mds: ceph osd pool create meta 1 2026-02-17T12:24:52.953 INFO:tasks.workunit.client.0.trial155.stderr:pool 'meta' already exists 2026-02-17T12:24:52.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:218: TEST_0_mds: ceph osd pool create data 1 2026-02-17T12:24:53.156 INFO:tasks.workunit.client.0.trial155.stderr:pool 'data' already exists 2026-02-17T12:24:53.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:219: TEST_0_mds: ceph fs new myfs meta data 2026-02-17T12:24:53.515 INFO:tasks.workunit.client.0.trial155.stderr:filesystem 'myfs' already exists 2026-02-17T12:24:53.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:220: TEST_0_mds: sleep 5 2026-02-17T12:24:58.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:222: TEST_0_mds: ceph mds ok-to-stop a 2026-02-17T12:24:58.693 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4129 and/or standby gids 2026-02-17T12:24:58.696 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:223: TEST_0_mds: ceph mds ok-to-stop a dne 2026-02-17T12:24:58.862 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4129 and/or standby gids 2026-02-17T12:24:58.865 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:224: TEST_0_mds: ceph mds ok-to-stop dne 2026-02-17T12:24:59.110 INFO:tasks.workunit.client.0.trial155.stderr:should be safe to stop [dne] 2026-02-17T12:24:59.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:226: TEST_0_mds: run_mds td/ok-to-stop b 2026-02-17T12:24:59.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:579: run_mds: local dir=td/ok-to-stop 2026-02-17T12:24:59.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:580: run_mds: shift 2026-02-17T12:24:59.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:581: run_mds: local id=b 2026-02-17T12:24:59.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:582: run_mds: shift 2026-02-17T12:24:59.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:583: run_mds: local data=td/ok-to-stop/b 2026-02-17T12:24:59.118 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:586: run_mds: get_asok_path 2026-02-17T12:24:59.118 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:24:59.118 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:24:59.118 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:24:59.118 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:24:59.118 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:24:59.118 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:24:59.118 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:586: run_mds: ceph-mds --id b --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' 2026-02-17T12:24:59.133 INFO:tasks.workunit.client.0.trial155.stdout:starting mds.b at 2026-02-17T12:24:59.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:227: TEST_0_mds: sleep 5 2026-02-17T12:25:04.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:229: TEST_0_mds: ceph mds ok-to-stop a 2026-02-17T12:25:04.382 INFO:tasks.workunit.client.0.trial155.stderr:should be safe to stop [a] 2026-02-17T12:25:04.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:230: TEST_0_mds: ceph mds ok-to-stop b 2026-02-17T12:25:04.634 INFO:tasks.workunit.client.0.trial155.stderr:should be safe to stop [b] 2026-02-17T12:25:04.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:231: TEST_0_mds: ceph mds ok-to-stop a b 2026-02-17T12:25:04.807 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4129 and/or standby gids 4143 2026-02-17T12:25:04.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:232: TEST_0_mds: ceph mds ok-to-stop a dne1 dne2 2026-02-17T12:25:05.056 INFO:tasks.workunit.client.0.trial155.stderr:should be safe to stop [a,dne1,dne2] 2026-02-17T12:25:05.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:233: TEST_0_mds: ceph mds ok-to-stop b dne 2026-02-17T12:25:05.309 INFO:tasks.workunit.client.0.trial155.stderr:should be safe to stop [b,dne] 2026-02-17T12:25:05.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:234: TEST_0_mds: ceph mds ok-to-stop a b dne 2026-02-17T12:25:05.481 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4129 and/or standby gids 4143 2026-02-17T12:25:05.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:235: TEST_0_mds: ceph mds ok-to-stop dne1 dne2 2026-02-17T12:25:05.730 INFO:tasks.workunit.client.0.trial155.stderr:should be safe to stop [dne1,dne2] 2026-02-17T12:25:05.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:237: TEST_0_mds: kill_daemons td/ok-to-stop KILL mds.a 2026-02-17T12:25:05.737 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:25:05.737 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:25:05.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:25:05.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:25:05.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:25:05.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:25:05.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-17T12:25:05.844 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:25:05.844 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:25:05.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:25:05.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:25:05.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:25:05.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:25:05.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-17T12:25:05.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:25:05.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:25:05.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:25:05.954 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:25:05.954 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:25:05.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:25:05.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:25:05.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:25:05.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:25:05.960 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:25:05.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:25:05.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:25:05.962 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:25:05.962 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:25:05.962 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:25:05.963 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:25:05.963 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:25:05.964 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:25:05.964 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:25:05.964 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:25:05.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:25:05.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:25:05.970 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:25:05.970 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:05.970 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:05.970 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:25:05.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:25:05.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:25:05.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-17T12:25:05.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-17T12:25:05.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2026-02-17T12:25:05.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2026-02-17T12:25:05.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:25:05.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:25:05.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:25:05.972 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:25:05.973 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:25:05.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:25:05.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:25:05.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:25:05.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:25:05.973 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:25:05.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:25:05.974 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:25:05.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:25:05.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:25:05.975 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:25:05.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:25:05.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:25:05.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:25:05.977 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:25:05.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:25:05.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:25:05.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:25:05.979 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:25:05.979 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:05.980 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:05.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:25:05.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:25:05.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:25:05.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2026-02-17T12:25:05.982 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:25:05.982 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:05.982 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:05.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.62907 2026-02-17T12:25:05.984 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:25:05.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:25:05.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:25:05.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-17T12:25:05.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_0_osd td/ok-to-stop 2026-02-17T12:25:05.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:241: TEST_0_osd: local dir=td/ok-to-stop 2026-02-17T12:25:05.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:243: TEST_0_osd: CEPH_ARGS='--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-17T12:25:05.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:245: TEST_0_osd: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-17T12:25:05.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:25:05.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:25:05.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:25:05.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:25:05.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2026-02-17T12:25:05.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-17T12:25:06.003 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:25:06.003 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:25:06.004 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:25:06.004 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:25:06.004 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:06.004 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:06.004 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:25:06.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-17T12:25:06.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:25:06.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:25:06.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:25:06.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:25:06.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:25:06.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:25:06.030 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:25:06.030 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:25:06.030 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:25:06.031 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:25:06.031 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:06.031 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:06.031 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:25:06.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:25:06.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get fsid 2026-02-17T12:25:06.079 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:25:06.079 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:25:06.079 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:25:06.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:25:06.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:25:06.080 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:25:06.080 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:25:06.080 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:25:06.080 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:25:06.080 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:06.080 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:06.080 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:25:06.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:25:06.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get mon_host 2026-02-17T12:25:06.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:246: TEST_0_osd: run_mgr td/ok-to-stop x 2026-02-17T12:25:06.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ok-to-stop 2026-02-17T12:25:06.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:25:06.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:25:06.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:25:06.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ok-to-stop/x 2026-02-17T12:25:06.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:25:06.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:25:06.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:25:06.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:25:06.222 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:25:06.222 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:06.222 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:06.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:25:06.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:25:06.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ok-to-stop/x '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:25:06.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:247: TEST_0_osd: run_osd td/ok-to-stop 0 2026-02-17T12:25:06.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ok-to-stop 2026-02-17T12:25:06.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:25:06.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ok-to-stop/0 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/0' 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/0/journal' 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2026-02-17T12:25:06.243 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2026-02-17T12:25:06.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:25:06.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:25:06.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:25:06.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:25:06.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:25:06.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:25:06.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ok-to-stop/0 2026-02-17T12:25:06.245 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:25:06.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=462ad3fb-e37a-4461-a1bc-55699dea2f7e 2026-02-17T12:25:06.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 462ad3fb-e37a-4461-a1bc-55699dea2f7e' 2026-02-17T12:25:06.246 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 462ad3fb-e37a-4461-a1bc-55699dea2f7e 2026-02-17T12:25:06.246 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:25:06.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAiXpRp8V8WDxAAYUJrbxWFiswOezHv68wMIg== 2026-02-17T12:25:06.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAiXpRp8V8WDxAAYUJrbxWFiswOezHv68wMIg=="}' 2026-02-17T12:25:06.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 462ad3fb-e37a-4461-a1bc-55699dea2f7e -i td/ok-to-stop/0/new.json 2026-02-17T12:25:06.357 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:25:06.364 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ok-to-stop/0/new.json 2026-02-17T12:25:06.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAiXpRp8V8WDxAAYUJrbxWFiswOezHv68wMIg== --osd-uuid 462ad3fb-e37a-4461-a1bc-55699dea2f7e 2026-02-17T12:25:06.382 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:06.380+0000 7f5b68f37780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:06.383 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:06.381+0000 7f5b68f37780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:06.384 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:06.382+0000 7f5b68f37780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:06.384 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:06.382+0000 7f5b68f37780 -1 bdev(0x5647537b5c00 td/ok-to-stop/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:25:06.384 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:06.382+0000 7f5b68f37780 -1 bluestore(td/ok-to-stop/0) _read_fsid unparsable uuid 2026-02-17T12:25:09.273 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ok-to-stop/0/keyring 2026-02-17T12:25:09.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:25:09.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:25:09.275 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:25:09.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ok-to-stop/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:25:09.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:25:09.535 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:25:09.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:25:09.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:25:09.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:25:09.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:25:09.551 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:09.549+0000 7f8274ed2780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:09.552 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:09.550+0000 7f8274ed2780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:09.553 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:09.551+0000 7f8274ed2780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:09.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:25:09.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:25:09.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:25:09.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:25:09.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:25:09.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:09.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:25:09.727 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:25:09.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:09.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:25:09.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:10.919 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:10.919 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:10.919 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:25:10.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:25:10.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:10.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:25:11.107 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:11.144 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:11.142+0000 7f8274ed2780 -1 Falling back to public interface 2026-02-17T12:25:12.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:12.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:12.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:25:12.108 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:25:12.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:12.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:25:12.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:13.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:13.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:13.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:25:13.300 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:25:13.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:13.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:25:13.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:14.087 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:14.085+0000 7f8274ed2780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:25:14.491 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:14.491 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:14.491 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:25:14.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:25:14.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:14.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:25:14.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:15.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:15.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:15.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:25:15.685 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:25:15.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:15.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:25:15.875 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/292272379,v1:127.0.0.1:6803/292272379] [v2:127.0.0.1:6804/292272379,v1:127.0.0.1:6805/292272379] exists,up 462ad3fb-e37a-4461-a1bc-55699dea2f7e 2026-02-17T12:25:15.875 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:248: TEST_0_osd: run_osd td/ok-to-stop 1 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ok-to-stop 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ok-to-stop/1 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/1' 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/1/journal' 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:25:15.876 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ok-to-stop/1 2026-02-17T12:25:15.877 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:25:15.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=1bcfba92-c6a9-4b99-a572-2b456b6b5a7e 2026-02-17T12:25:15.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 1bcfba92-c6a9-4b99-a572-2b456b6b5a7e' 2026-02-17T12:25:15.878 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 1bcfba92-c6a9-4b99-a572-2b456b6b5a7e 2026-02-17T12:25:15.878 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:25:15.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQArXpRpUbz5NBAAqg7Z15y+vkJrBKBH+kVC+w== 2026-02-17T12:25:15.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQArXpRpUbz5NBAAqg7Z15y+vkJrBKBH+kVC+w=="}' 2026-02-17T12:25:15.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 1bcfba92-c6a9-4b99-a572-2b456b6b5a7e -i td/ok-to-stop/1/new.json 2026-02-17T12:25:16.078 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:25:16.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ok-to-stop/1/new.json 2026-02-17T12:25:16.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/1 --osd-journal=td/ok-to-stop/1/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQArXpRpUbz5NBAAqg7Z15y+vkJrBKBH+kVC+w== --osd-uuid 1bcfba92-c6a9-4b99-a572-2b456b6b5a7e 2026-02-17T12:25:16.102 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:16.100+0000 7f5c91623780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:16.103 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:16.102+0000 7f5c91623780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:16.104 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:16.102+0000 7f5c91623780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:16.104 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:16.103+0000 7f5c91623780 -1 bdev(0x56503c563c00 td/ok-to-stop/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:25:16.104 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:16.103+0000 7f5c91623780 -1 bluestore(td/ok-to-stop/1) _read_fsid unparsable uuid 2026-02-17T12:25:18.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ok-to-stop/1/keyring 2026-02-17T12:25:18.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:25:18.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:25:18.223 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:25:18.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ok-to-stop/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:25:18.480 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:25:18.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:25:18.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/1 --osd-journal=td/ok-to-stop/1/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:25:18.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:25:18.480 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:25:18.481 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:25:18.496 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:18.495+0000 7fe89d0cc780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:18.497 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:18.496+0000 7fe89d0cc780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:18.498 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:18.497+0000 7fe89d0cc780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:18.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:25:18.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:25:18.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:25:18.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:25:18.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:25:18.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:18.670 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:25:18.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:25:18.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:18.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:25:18.856 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:19.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:19.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:19.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:25:19.857 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:25:19.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:19.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:25:20.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:20.080 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:20.078+0000 7fe89d0cc780 -1 Falling back to public interface 2026-02-17T12:25:21.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:21.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:21.046 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:25:21.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:25:21.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:21.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:25:21.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:22.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:22.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:22.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:25:22.237 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:25:22.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:22.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:25:22.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:23.020 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:23.019+0000 7fe89d0cc780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:25:23.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:23.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:23.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:25:23.426 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:25:23.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:23.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:25:23.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:24.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:24.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:24.624 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:25:24.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:25:24.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:24.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:25:24.812 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3894101814,v1:127.0.0.1:6811/3894101814] [v2:127.0.0.1:6812/3894101814,v1:127.0.0.1:6813/3894101814] exists,up 1bcfba92-c6a9-4b99-a572-2b456b6b5a7e 2026-02-17T12:25:24.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:25:24.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:25:24.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:25:24.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:249: TEST_0_osd: run_osd td/ok-to-stop 2 2026-02-17T12:25:24.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ok-to-stop 2026-02-17T12:25:24.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:25:24.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:25:24.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ok-to-stop/2 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/2' 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/2/journal' 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:25:24.817 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2026-02-17T12:25:24.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:25:24.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:25:24.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:25:24.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:25:24.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:25:24.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:25:24.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ok-to-stop/2 2026-02-17T12:25:24.819 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:25:24.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c69e5c17-e78f-4675-b417-ea242c4f2f94 2026-02-17T12:25:24.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 c69e5c17-e78f-4675-b417-ea242c4f2f94' 2026-02-17T12:25:24.820 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 c69e5c17-e78f-4675-b417-ea242c4f2f94 2026-02-17T12:25:24.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:25:24.827 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA0XpRp0DQ8MRAA4g3DCZWf5X1A0Yim7rKAgw== 2026-02-17T12:25:24.828 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA0XpRp0DQ8MRAA4g3DCZWf5X1A0Yim7rKAgw=="}' 2026-02-17T12:25:24.828 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c69e5c17-e78f-4675-b417-ea242c4f2f94 -i td/ok-to-stop/2/new.json 2026-02-17T12:25:25.018 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:25:25.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ok-to-stop/2/new.json 2026-02-17T12:25:25.027 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/2 --osd-journal=td/ok-to-stop/2/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA0XpRp0DQ8MRAA4g3DCZWf5X1A0Yim7rKAgw== --osd-uuid c69e5c17-e78f-4675-b417-ea242c4f2f94 2026-02-17T12:25:25.044 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:25.043+0000 7f3581e27780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:25.046 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:25.044+0000 7f3581e27780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:25.046 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:25.045+0000 7f3581e27780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:25.047 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:25.045+0000 7f3581e27780 -1 bdev(0x55a0fe2a1c00 td/ok-to-stop/2/block) open stat got: (1) Operation not permitted 2026-02-17T12:25:25.047 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:25.045+0000 7f3581e27780 -1 bluestore(td/ok-to-stop/2) _read_fsid unparsable uuid 2026-02-17T12:25:27.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ok-to-stop/2/keyring 2026-02-17T12:25:27.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:25:27.408 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:25:27.408 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:25:27.409 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ok-to-stop/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:25:27.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:25:27.662 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:25:27.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/2 --osd-journal=td/ok-to-stop/2/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:25:27.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:25:27.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:25:27.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:25:27.677 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:27.676+0000 7fa0a5e12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:27.679 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:27.677+0000 7fa0a5e12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:27.679 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:27.678+0000 7fa0a5e12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:27.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:25:27.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:25:27.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:25:27.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:25:27.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:25:27.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:27.857 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:25:27.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:25:27.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:27.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:25:28.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:29.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:29.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:29.047 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:25:29.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:25:29.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:29.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:25:29.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:29.271 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:29.270+0000 7fa0a5e12780 -1 Falling back to public interface 2026-02-17T12:25:30.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:30.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:30.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:25:30.235 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:25:30.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:30.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:25:30.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:31.423 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:31.423 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:31.423 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:25:31.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:25:31.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:31.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:25:31.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:31.972 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:31.970+0000 7fa0a5e12780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:25:32.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:32.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:32.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:25:32.615 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:25:32.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:32.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:25:32.801 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1242849794,v1:127.0.0.1:6819/1242849794] [v2:127.0.0.1:6820/1242849794,v1:127.0.0.1:6821/1242849794] exists,up c69e5c17-e78f-4675-b417-ea242c4f2f94 2026-02-17T12:25:32.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:25:32.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:25:32.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:25:32.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:250: TEST_0_osd: run_osd td/ok-to-stop 3 2026-02-17T12:25:32.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ok-to-stop 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ok-to-stop/3 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/3' 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/3/journal' 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:25:32.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:25:32.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ok-to-stop/3 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=df5ff887-d84e-454c-b073-7991845474a6 2026-02-17T12:25:32.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 df5ff887-d84e-454c-b073-7991845474a6' 2026-02-17T12:25:32.809 INFO:tasks.workunit.client.0.trial155.stdout:add osd3 df5ff887-d84e-454c-b073-7991845474a6 2026-02-17T12:25:32.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:25:32.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA8XpRpV5uQMBAArMk7d9JN/oz1UDbbxo1aPg== 2026-02-17T12:25:32.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA8XpRpV5uQMBAArMk7d9JN/oz1UDbbxo1aPg=="}' 2026-02-17T12:25:32.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new df5ff887-d84e-454c-b073-7991845474a6 -i td/ok-to-stop/3/new.json 2026-02-17T12:25:33.005 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:25:33.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ok-to-stop/3/new.json 2026-02-17T12:25:33.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/3 --osd-journal=td/ok-to-stop/3/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA8XpRpV5uQMBAArMk7d9JN/oz1UDbbxo1aPg== --osd-uuid df5ff887-d84e-454c-b073-7991845474a6 2026-02-17T12:25:33.030 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:33.028+0000 7ffae7d64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:33.031 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:33.030+0000 7ffae7d64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:33.032 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:33.031+0000 7ffae7d64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:33.033 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:33.031+0000 7ffae7d64780 -1 bdev(0x557207aedc00 td/ok-to-stop/3/block) open stat got: (1) Operation not permitted 2026-02-17T12:25:33.033 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:33.031+0000 7ffae7d64780 -1 bluestore(td/ok-to-stop/3) _read_fsid unparsable uuid 2026-02-17T12:25:35.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ok-to-stop/3/keyring 2026-02-17T12:25:35.157 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:25:35.157 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T12:25:35.158 INFO:tasks.workunit.client.0.trial155.stdout:adding osd3 key to auth repository 2026-02-17T12:25:35.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ok-to-stop/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:25:35.418 INFO:tasks.workunit.client.0.trial155.stdout:start osd.3 2026-02-17T12:25:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T12:25:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/3 --osd-journal=td/ok-to-stop/3/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:25:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:25:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:25:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:25:35.432 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:35.431+0000 7f75feb64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:35.433 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:35.432+0000 7f75feb64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:35.434 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:35.433+0000 7f75feb64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:25:35.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T12:25:35.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:25:35.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T12:25:35.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:25:35.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:25:35.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:35.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:25:35.611 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:25:35.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:35.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T12:25:35.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:36.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:36.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:36.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:25:36.804 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:25:36.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:36.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T12:25:36.993 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:37.023 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:37.021+0000 7f75feb64780 -1 Falling back to public interface 2026-02-17T12:25:37.994 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:37.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:37.995 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:25:37.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:25:37.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:37.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T12:25:38.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:39.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:39.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:39.187 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:25:39.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:25:39.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:39.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T12:25:39.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:25:39.966 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:25:39.964+0000 7f75feb64780 -1 osd.3 0 log_to_monitors true 2026-02-17T12:25:40.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:25:40.383 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:25:40.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:25:40.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:25:40.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:25:40.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T12:25:40.577 INFO:tasks.workunit.client.0.trial155.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3586580497,v1:127.0.0.1:6827/3586580497] [v2:127.0.0.1:6828/3586580497,v1:127.0.0.1:6829/3586580497] exists,up df5ff887-d84e-454c-b073-7991845474a6 2026-02-17T12:25:40.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:25:40.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:25:40.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:25:40.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:252: TEST_0_osd: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-17T12:25:40.825 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:253: TEST_0_osd: ceph osd pool create ec erasure ec-profile 2026-02-17T12:25:41.125 INFO:tasks.workunit.client.0.trial155.stderr:pool 'ec' already exists 2026-02-17T12:25:41.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:255: TEST_0_osd: wait_for_clean 2026-02-17T12:25:41.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:25:41.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:25:41.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:25:41.134 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:25:41.135 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:25:41.135 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:25:41.135 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:25:41.135 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:25:41.135 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:25:41.220 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:25:41.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:25:41.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:25:41.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:25:41.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:25:41.221 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:25:41.410 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:25:41.410 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:25:41.410 INFO:tasks.workunit.client.0.trial155.stderr:2 2026-02-17T12:25:41.410 INFO:tasks.workunit.client.0.trial155.stderr:3' 2026-02-17T12:25:41.410 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:25:41.410 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:41.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:25:41.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836488 2026-02-17T12:25:41.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836488 2026-02-17T12:25:41.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836488' 2026-02-17T12:25:41.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:41.472 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:25:41.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705671 2026-02-17T12:25:41.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705671 2026-02-17T12:25:41.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836488 1-38654705671' 2026-02-17T12:25:41.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:41.536 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:25:41.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542148 2026-02-17T12:25:41.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542148 2026-02-17T12:25:41.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836488 1-38654705671 2-60129542148' 2026-02-17T12:25:41.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:41.595 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T12:25:41.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411331 2026-02-17T12:25:41.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411331 2026-02-17T12:25:41.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836488 1-38654705671 2-60129542148 3-77309411331' 2026-02-17T12:25:41.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:41.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836488 2026-02-17T12:25:41.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:41.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:25:41.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836488 2026-02-17T12:25:41.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:41.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836488 2026-02-17T12:25:41.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-17T12:25:41.662 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836488 2026-02-17T12:25:41.662 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:25:41.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836485 -lt 21474836488 2026-02-17T12:25:41.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:25:42.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:25:42.851 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:25:43.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-17T12:25:43.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:43.040 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705671 2026-02-17T12:25:43.040 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:43.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:25:43.042 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705671 2026-02-17T12:25:43.042 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:43.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705671 2026-02-17T12:25:43.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-17T12:25:43.043 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 38654705671 2026-02-17T12:25:43.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:25:43.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705671 -lt 38654705671 2026-02-17T12:25:43.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:43.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542148 2026-02-17T12:25:43.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:43.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:25:43.237 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542148 2026-02-17T12:25:43.237 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:43.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542148 2026-02-17T12:25:43.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-17T12:25:43.238 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 60129542148 2026-02-17T12:25:43.239 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:25:43.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-17T12:25:43.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:43.426 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-77309411331 2026-02-17T12:25:43.426 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:43.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T12:25:43.428 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-77309411331 2026-02-17T12:25:43.428 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:43.428 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411331 2026-02-17T12:25:43.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 77309411331' 2026-02-17T12:25:43.429 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.3 seq 77309411331 2026-02-17T12:25:43.429 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T12:25:43.618 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411331 -lt 77309411331 2026-02-17T12:25:43.618 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:25:43.619 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:25:43.619 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:25:43.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 32 == 0 2026-02-17T12:25:43.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:25:43.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:25:43.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:25:43.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:25:43.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:25:43.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:25:43.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:25:44.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=32 2026-02-17T12:25:44.068 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:25:44.068 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:25:44.068 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:25:44.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 32 = 32 2026-02-17T12:25:44.318 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:25:44.318 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:25:44.318 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:258: TEST_0_osd: ceph osd pool set ec min_size 3 2026-02-17T12:25:44.584 INFO:tasks.workunit.client.0.trial155.stderr:set pool 1 min_size to 3 2026-02-17T12:25:44.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:259: TEST_0_osd: wait_for_clean 2026-02-17T12:25:44.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:25:44.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:25:44.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:25:44.592 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:25:44.592 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:25:44.592 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:25:44.592 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:25:44.592 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:25:44.592 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:25:44.675 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:25:44.675 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:25:44.675 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:25:44.675 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:25:44.675 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:25:44.675 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:25:44.860 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:25:44.860 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:25:44.860 INFO:tasks.workunit.client.0.trial155.stderr:2 2026-02-17T12:25:44.860 INFO:tasks.workunit.client.0.trial155.stderr:3' 2026-02-17T12:25:44.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:25:44.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:44.861 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:25:44.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836490 2026-02-17T12:25:44.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836490 2026-02-17T12:25:44.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T12:25:44.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:44.922 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:25:44.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705674 2026-02-17T12:25:44.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705674 2026-02-17T12:25:44.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490 1-38654705674' 2026-02-17T12:25:44.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:44.985 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:25:45.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542151 2026-02-17T12:25:45.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542151 2026-02-17T12:25:45.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490 1-38654705674 2-60129542151' 2026-02-17T12:25:45.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:45.045 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T12:25:45.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411333 2026-02-17T12:25:45.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411333 2026-02-17T12:25:45.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490 1-38654705674 2-60129542151 3-77309411333' 2026-02-17T12:25:45.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:45.108 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836490 2026-02-17T12:25:45.108 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:45.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:25:45.109 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836490 2026-02-17T12:25:45.109 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:45.110 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836490 2026-02-17T12:25:45.111 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T12:25:45.111 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836490 2026-02-17T12:25:45.111 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:25:45.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-17T12:25:45.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:25:46.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:25:46.301 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:25:46.499 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836491 -lt 21474836490 2026-02-17T12:25:46.499 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:46.500 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705674 2026-02-17T12:25:46.500 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:46.500 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:25:46.501 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705674 2026-02-17T12:25:46.501 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:46.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705674 2026-02-17T12:25:46.502 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 38654705674 2026-02-17T12:25:46.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T12:25:46.503 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:25:46.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T12:25:46.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:46.692 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542151 2026-02-17T12:25:46.693 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:46.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:25:46.694 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542151 2026-02-17T12:25:46.694 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:46.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542151 2026-02-17T12:25:46.696 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 60129542151 2026-02-17T12:25:46.696 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542151' 2026-02-17T12:25:46.696 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:25:46.886 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542151 -lt 60129542151 2026-02-17T12:25:46.886 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:46.886 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-77309411333 2026-02-17T12:25:46.886 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:46.887 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T12:25:46.888 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-77309411333 2026-02-17T12:25:46.888 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:46.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411333 2026-02-17T12:25:46.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 77309411333' 2026-02-17T12:25:46.889 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.3 seq 77309411333 2026-02-17T12:25:46.889 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T12:25:47.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411334 -lt 77309411333 2026-02-17T12:25:47.079 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:25:47.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:25:47.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:25:47.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 32 == 0 2026-02-17T12:25:47.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:25:47.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:25:47.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:25:47.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:25:47.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:25:47.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:25:47.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:25:47.513 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=32 2026-02-17T12:25:47.514 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:25:47.514 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:25:47.514 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:25:47.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 32 = 32 2026-02-17T12:25:47.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:25:47.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:25:47.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:261: TEST_0_osd: ceph osd ok-to-stop 0 2026-02-17T12:25:47.947 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[0],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:47.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:262: TEST_0_osd: ceph osd ok-to-stop 1 2026-02-17T12:25:48.134 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:48.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:263: TEST_0_osd: ceph osd ok-to-stop 2 2026-02-17T12:25:48.320 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[2],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:48.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:264: TEST_0_osd: ceph osd ok-to-stop 3 2026-02-17T12:25:48.512 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[3],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:48.519 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:265: TEST_0_osd: ceph osd ok-to-stop 0 1 2026-02-17T12:25:48.654 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":false,"osds":[0,1],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:48.654 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-17T12:25:48.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:266: TEST_0_osd: ceph osd ok-to-stop 2 3 2026-02-17T12:25:48.788 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":false,"osds":[2,3],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:48.789 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-17T12:25:48.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:267: TEST_0_osd: ceph osd ok-to-stop 0 --max 2 2026-02-17T12:25:48.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:267: TEST_0_osd: grep '[0]' 2026-02-17T12:25:48.980 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[0],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:48.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:268: TEST_0_osd: ceph osd ok-to-stop 1 --max 2 2026-02-17T12:25:48.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:268: TEST_0_osd: grep '[1]' 2026-02-17T12:25:49.167 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:49.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:271: TEST_0_osd: ceph osd pool set ec min_size 2 2026-02-17T12:25:49.499 INFO:tasks.workunit.client.0.trial155.stderr:set pool 1 min_size to 2 2026-02-17T12:25:49.512 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:272: TEST_0_osd: wait_for_clean 2026-02-17T12:25:49.512 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:25:49.512 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:25:49.513 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:25:49.513 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:25:49.513 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:25:49.513 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:25:49.513 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:25:49.513 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:25:49.513 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:25:49.594 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:25:49.594 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:25:49.594 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:25:49.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:25:49.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:25:49.595 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:25:49.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:25:49.786 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:25:49.786 INFO:tasks.workunit.client.0.trial155.stderr:2 2026-02-17T12:25:49.786 INFO:tasks.workunit.client.0.trial155.stderr:3' 2026-02-17T12:25:49.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:25:49.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:49.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:25:49.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836493 2026-02-17T12:25:49.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836493 2026-02-17T12:25:49.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836493' 2026-02-17T12:25:49.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:49.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:25:49.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705677 2026-02-17T12:25:49.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705677 2026-02-17T12:25:49.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836493 1-38654705677' 2026-02-17T12:25:49.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:49.912 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:25:49.970 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542154 2026-02-17T12:25:49.970 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542154 2026-02-17T12:25:49.970 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836493 1-38654705677 2-60129542154' 2026-02-17T12:25:49.971 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:49.971 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T12:25:50.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411336 2026-02-17T12:25:50.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411336 2026-02-17T12:25:50.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836493 1-38654705677 2-60129542154 3-77309411336' 2026-02-17T12:25:50.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:50.032 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836493 2026-02-17T12:25:50.032 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:50.032 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:25:50.033 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836493 2026-02-17T12:25:50.033 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:50.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836493 2026-02-17T12:25:50.034 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836493 2026-02-17T12:25:50.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-17T12:25:50.034 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:25:50.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836491 -lt 21474836493 2026-02-17T12:25:50.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:25:51.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:25:51.226 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:25:51.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-17T12:25:51.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:51.414 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705677 2026-02-17T12:25:51.414 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:51.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:25:51.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705677 2026-02-17T12:25:51.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:51.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705677 2026-02-17T12:25:51.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705677' 2026-02-17T12:25:51.417 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 38654705677 2026-02-17T12:25:51.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:25:51.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705677 -lt 38654705677 2026-02-17T12:25:51.609 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:51.609 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542154 2026-02-17T12:25:51.609 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:51.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:25:51.610 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542154 2026-02-17T12:25:51.611 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:51.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542154 2026-02-17T12:25:51.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-17T12:25:51.612 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 60129542154 2026-02-17T12:25:51.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:25:51.797 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542154 -lt 60129542154 2026-02-17T12:25:51.797 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:51.797 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-77309411336 2026-02-17T12:25:51.797 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:51.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T12:25:51.799 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-77309411336 2026-02-17T12:25:51.799 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:51.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411336 2026-02-17T12:25:51.800 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.3 seq 77309411336 2026-02-17T12:25:51.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 77309411336' 2026-02-17T12:25:51.800 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T12:25:51.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411336 -lt 77309411336 2026-02-17T12:25:51.984 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:25:51.984 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:25:51.985 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:25:52.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 32 == 0 2026-02-17T12:25:52.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:25:52.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:25:52.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:25:52.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:25:52.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:25:52.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:25:52.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:25:52.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=32 2026-02-17T12:25:52.418 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:25:52.418 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:25:52.419 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:25:52.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 32 = 32 2026-02-17T12:25:52.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:25:52.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:25:52.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:274: TEST_0_osd: ceph osd ok-to-stop 0 1 2026-02-17T12:25:52.843 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[0,1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:52.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:275: TEST_0_osd: ceph osd ok-to-stop 2 3 2026-02-17T12:25:53.033 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[2,3],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:53.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:276: TEST_0_osd: ceph osd ok-to-stop 0 1 2 2026-02-17T12:25:53.171 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":false,"osds":[0,1,2],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:53.172 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-17T12:25:53.174 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:277: TEST_0_osd: ceph osd ok-to-stop 1 2 3 2026-02-17T12:25:53.305 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":false,"osds":[1,2,3],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:53.306 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-17T12:25:53.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:279: TEST_0_osd: ceph osd ok-to-stop 0 --max 2 2026-02-17T12:25:53.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:279: TEST_0_osd: grep '[0,1]' 2026-02-17T12:25:53.497 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[0,1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:53.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:280: TEST_0_osd: ceph osd ok-to-stop 0 --max 20 2026-02-17T12:25:53.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:280: TEST_0_osd: grep '[0,1]' 2026-02-17T12:25:53.682 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[0,1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:53.682 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:281: TEST_0_osd: ceph osd ok-to-stop 2 --max 2 2026-02-17T12:25:53.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:281: TEST_0_osd: grep '[2,3]' 2026-02-17T12:25:53.872 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[0,2],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:53.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:282: TEST_0_osd: ceph osd ok-to-stop 2 --max 20 2026-02-17T12:25:53.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:282: TEST_0_osd: grep '[2,3]' 2026-02-17T12:25:54.071 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[0,2],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:54.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:285: TEST_0_osd: kill_daemons td/ok-to-stop TERM osd.0 2026-02-17T12:25:54.072 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:25:54.072 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:25:54.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:25:54.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:25:54.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:25:55.380 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:25:55.380 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:286: TEST_0_osd: ceph osd down 0 2026-02-17T12:25:55.569 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 is already down. 2026-02-17T12:25:55.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:287: TEST_0_osd: wait_for_peered 2026-02-17T12:25:55.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1740: wait_for_peered: local cmd= 2026-02-17T12:25:55.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1741: wait_for_peered: local num_peered=-1 2026-02-17T12:25:55.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1742: wait_for_peered: local cur_peered 2026-02-17T12:25:55.576 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_peered: get_timeout_delays 90 .1 2026-02-17T12:25:55.577 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:25:55.577 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:25:55.577 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:25:55.577 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:25:55.577 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:25:55.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_peered: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:25:55.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_peered: local -a delays 2026-02-17T12:25:55.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_peered: local -i loop=0 2026-02-17T12:25:55.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_peered: flush_pg_stats 2026-02-17T12:25:55.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:25:55.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:25:55.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:25:55.847 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:25:55.847 INFO:tasks.workunit.client.0.trial155.stderr:2 2026-02-17T12:25:55.847 INFO:tasks.workunit.client.0.trial155.stderr:3' 2026-02-17T12:25:55.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:25:55.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:55.847 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:25:55.891 INFO:tasks.workunit.client.0.trial155.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-17T12:25:55.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq= 2026-02-17T12:25:55.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z '' 2026-02-17T12:25:55.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: continue 2026-02-17T12:25:55.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:55.893 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:25:55.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705680 2026-02-17T12:25:55.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705680 2026-02-17T12:25:55.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 1-38654705680' 2026-02-17T12:25:55.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:55.954 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:25:56.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542157 2026-02-17T12:25:56.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542157 2026-02-17T12:25:56.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 1-38654705680 2-60129542157' 2026-02-17T12:25:56.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:25:56.015 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T12:25:56.075 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411339 2026-02-17T12:25:56.075 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411339 2026-02-17T12:25:56.075 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 1-38654705680 2-60129542157 3-77309411339' 2026-02-17T12:25:56.075 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:56.075 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705680 2026-02-17T12:25:56.075 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:56.076 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:25:56.077 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705680 2026-02-17T12:25:56.077 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:56.077 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705680 2026-02-17T12:25:56.077 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705680' 2026-02-17T12:25:56.078 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 38654705680 2026-02-17T12:25:56.078 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:25:56.271 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705678 -lt 38654705680 2026-02-17T12:25:56.271 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:25:57.272 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:25:57.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:25:57.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705680 -lt 38654705680 2026-02-17T12:25:57.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:57.459 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542157 2026-02-17T12:25:57.459 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:57.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:25:57.461 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542157 2026-02-17T12:25:57.461 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:57.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542157 2026-02-17T12:25:57.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542157' 2026-02-17T12:25:57.462 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 60129542157 2026-02-17T12:25:57.462 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:25:57.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542157 -lt 60129542157 2026-02-17T12:25:57.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:25:57.651 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-77309411339 2026-02-17T12:25:57.651 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:25:57.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T12:25:57.652 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-77309411339 2026-02-17T12:25:57.653 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:25:57.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411339 2026-02-17T12:25:57.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 77309411339' 2026-02-17T12:25:57.654 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.3 seq 77309411339 2026-02-17T12:25:57.655 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T12:25:57.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411340 -lt 77309411339 2026-02-17T12:25:57.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1747: wait_for_peered: get_num_pgs 2026-02-17T12:25:57.850 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:25:57.850 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:25:58.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1747: wait_for_peered: test 32 == 0 2026-02-17T12:25:58.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1751: wait_for_peered: true 2026-02-17T12:25:58.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1755: wait_for_peered: get_num_active_or_peered 2026-02-17T12:25:58.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1394: get_num_active_or_peered: local expression 2026-02-17T12:25:58.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1395: get_num_active_or_peered: expression+='select(contains("active") or contains("peered")) | ' 2026-02-17T12:25:58.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1396: get_num_active_or_peered: expression+='select(contains("stale") | not)' 2026-02-17T12:25:58.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1397: get_num_active_or_peered: ceph --format json pg dump pgs 2026-02-17T12:25:58.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1398: get_num_active_or_peered: jq '.pg_stats | [.[] | .state | select(contains("active") or contains("peered")) | select(contains("stale") | not)] | length' 2026-02-17T12:25:58.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1755: wait_for_peered: cur_peered=32 2026-02-17T12:25:58.284 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1756: wait_for_peered: get_num_pgs 2026-02-17T12:25:58.285 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:25:58.285 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:25:58.538 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1756: wait_for_peered: test 32 = 32 2026-02-17T12:25:58.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1756: wait_for_peered: break 2026-02-17T12:25:58.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1771: wait_for_peered: return 0 2026-02-17T12:25:58.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:289: TEST_0_osd: ceph osd ok-to-stop 0 2026-02-17T12:25:58.719 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[0],"num_ok_pgs":0,"num_not_ok_pgs":0} 2026-02-17T12:25:58.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:290: TEST_0_osd: ceph osd ok-to-stop 0 1 2026-02-17T12:25:58.906 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":true,"osds":[0,1],"num_ok_pgs":32,"num_not_ok_pgs":0,"ok_become_degraded":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:58.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:291: TEST_0_osd: ceph osd ok-to-stop 0 1 2 2026-02-17T12:25:59.049 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":false,"osds":[0,1,2],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:59.049 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-17T12:25:59.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:292: TEST_0_osd: ceph osd ok-to-stop 1 2 3 2026-02-17T12:25:59.185 INFO:tasks.workunit.client.0.trial155.stdout:{"ok_to_stop":false,"osds":[1,2,3],"num_ok_pgs":0,"num_not_ok_pgs":32,"bad_become_inactive":["1.0","1.1","1.2","1.3","1.4","1.5","1.6","1.7","1.8","1.9","1.a","1.b","1.c","1.d","1.e","1.f","1.10","1.11","1.12","1.13","1.14","1.15","1.16","1.17","1.18","1.19","1.1a","1.1b","1.1c","1.1d","1.1e","1.1f"]} 2026-02-17T12:25:59.185 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: unsafe to stop osd(s) at this time (32 PGs are or would become offline) 2026-02-17T12:25:59.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-17T12:25:59.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:25:59.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:25:59.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:25:59.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:25:59.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:25:59.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:25:59.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-17T12:25:59.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:25:59.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:25:59.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:25:59.298 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:25:59.298 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:25:59.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:25:59.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:25:59.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:25:59.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:25:59.305 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:25:59.305 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:25:59.306 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:25:59.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:25:59.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:25:59.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:25:59.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:25:59.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:25:59.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:25:59.308 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:25:59.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:25:59.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:25:59.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:25:59.324 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:25:59.324 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:59.324 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:59.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:25:59.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:25:59.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:25:59.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-17T12:25:59.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-17T12:25:59.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2026-02-17T12:25:59.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2026-02-17T12:25:59.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:25:59.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:25:59.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:25:59.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:25:59.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:25:59.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:25:59.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:25:59.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:25:59.328 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:25:59.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:25:59.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:25:59.329 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:25:59.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:25:59.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:25:59.330 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:25:59.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:25:59.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:25:59.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:25:59.331 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:25:59.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:25:59.333 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:25:59.333 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:25:59.334 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:25:59.334 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:59.334 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:59.334 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:25:59.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:25:59.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:25:59.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2026-02-17T12:25:59.336 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:25:59.336 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:59.336 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:59.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.62907 2026-02-17T12:25:59.337 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_1_mon_checks td/ok-to-stop 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:28: TEST_1_mon_checks: local dir=td/ok-to-stop 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:30: TEST_1_mon_checks: CEPH_ARGS='--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150 ' 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:32: TEST_1_mon_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2026-02-17T12:25:59.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-17T12:25:59.357 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:25:59.357 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:25:59.357 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:25:59.358 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:25:59.358 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:59.358 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:59.358 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:25:59.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-17T12:25:59.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:25:59.385 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:25:59.385 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:25:59.385 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:25:59.385 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:25:59.385 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:25:59.385 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:25:59.385 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:25:59.385 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:25:59.386 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:25:59.386 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:59.386 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:59.386 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:25:59.387 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:25:59.387 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get fsid 2026-02-17T12:25:59.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:25:59.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:25:59.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:25:59.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:25:59.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:25:59.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:25:59.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:25:59.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:25:59.434 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:25:59.434 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:25:59.434 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:25:59.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:25:59.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:25:59.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get mon_host 2026-02-17T12:25:59.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:34: TEST_1_mon_checks: ceph mon ok-to-stop dne 2026-02-17T12:25:59.568 INFO:tasks.workunit.client.0.trial155.stderr:invalid mon(s) specified: [dne] 2026-02-17T12:25:59.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:35: TEST_1_mon_checks: ceph mon ok-to-stop a 2026-02-17T12:25:59.650 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available () after stopping mons [a] 2026-02-17T12:25:59.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:37: TEST_1_mon_checks: ceph mon ok-to-add-offline 2026-02-17T12:25:59.726 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: adding a monitor may break quorum (until that monitor starts) 2026-02-17T12:25:59.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:39: TEST_1_mon_checks: ceph mon ok-to-rm a 2026-02-17T12:25:59.803 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: removing mon.a would break quorum 2026-02-17T12:25:59.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:40: TEST_1_mon_checks: ceph mon ok-to-rm dne 2026-02-17T12:25:59.899 INFO:tasks.workunit.client.0.trial155.stderr:mon.dne does not exist 2026-02-17T12:25:59.905 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-17T12:25:59.906 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:25:59.906 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:25:59.906 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:25:59.906 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:25:59.906 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:00.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:00.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-17T12:26:00.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:26:00.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:26:00.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:26:00.012 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:00.012 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:00.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:00.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:00.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:00.017 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:00.017 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:26:00.018 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:26:00.018 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:26:00.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:26:00.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:26:00.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:26:00.020 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:00.020 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:26:00.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:26:00.021 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:00.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:26:00.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:26:00.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:26:00.024 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:26:00.024 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:00.024 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:00.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:26:00.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:26:00.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:26:00.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-17T12:26:00.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-17T12:26:00.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2026-02-17T12:26:00.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2026-02-17T12:26:00.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:26:00.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:26:00.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:26:00.026 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:00.026 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:00.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:00.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:00.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:00.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:00.028 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:26:00.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:26:00.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:26:00.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:26:00.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:26:00.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:26:00.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:00.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:26:00.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:26:00.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:00.032 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:26:00.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:26:00.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:26:00.034 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:26:00.034 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:00.034 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:00.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:26:00.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:26:00.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:26:00.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2026-02-17T12:26:00.036 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:26:00.036 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:00.036 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:00.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.62907 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_2_mons_checks td/ok-to-stop 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:44: TEST_2_mons_checks: local dir=td/ok-to-stop 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:46: TEST_2_mons_checks: CEPH_ARGS='--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151 ' 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:48: TEST_2_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2026-02-17T12:26:00.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-17T12:26:00.057 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:00.057 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:00.057 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:00.057 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:00.058 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:00.058 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:00.058 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:00.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-17T12:26:00.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:00.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:26:00.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:00.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:26:00.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:00.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:00.086 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:26:00.087 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:26:00.087 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:26:00.087 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:00.087 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:00.087 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:00.087 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:26:00.087 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:00.087 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get fsid 2026-02-17T12:26:00.132 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:26:00.132 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:00.132 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:26:00.132 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:00.132 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:00.132 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:26:00.132 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:26:00.132 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:26:00.132 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:00.132 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:00.133 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:00.133 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:26:00.133 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:00.133 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get mon_host 2026-02-17T12:26:00.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:49: TEST_2_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2026-02-17T12:26:00.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:00.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:00.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2026-02-17T12:26:00.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:00.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/b 2026-02-17T12:26:00.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2026-02-17T12:26:00.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:00.194 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:00.194 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:00.194 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:00.194 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:00.194 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:00.194 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:00.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2026-02-17T12:26:00.219 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:00.220 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b fsid 2026-02-17T12:26:00.221 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:00.221 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:26:00.221 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:00.221 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:00.222 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:26:00.222 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:26:00.222 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:26:00.222 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:00.222 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:00.223 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:00.223 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.b.asok 2026-02-17T12:26:00.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:00.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.b.asok config get fsid 2026-02-17T12:26:00.267 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b mon_host 2026-02-17T12:26:00.268 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:00.268 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:26:00.268 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:00.268 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:00.268 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:26:00.268 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:26:00.268 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:26:00.269 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:00.269 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:00.269 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:00.269 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.b.asok 2026-02-17T12:26:00.269 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:00.270 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.b.asok config get mon_host 2026-02-17T12:26:00.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:51: TEST_2_mons_checks: ceph mon ok-to-stop dne 2026-02-17T12:26:00.407 INFO:tasks.workunit.client.0.trial155.stderr:invalid mon(s) specified: [dne] 2026-02-17T12:26:00.413 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:52: TEST_2_mons_checks: ceph mon ok-to-stop a 2026-02-17T12:26:00.488 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (b) after stopping mons [a] 2026-02-17T12:26:00.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:53: TEST_2_mons_checks: ceph mon ok-to-stop b 2026-02-17T12:26:00.565 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (a) after stopping mons [b] 2026-02-17T12:26:00.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:54: TEST_2_mons_checks: ceph mon ok-to-stop a b 2026-02-17T12:26:00.642 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available () after stopping mons [a,b] 2026-02-17T12:26:00.645 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:56: TEST_2_mons_checks: ceph mon ok-to-add-offline 2026-02-17T12:26:00.738 INFO:tasks.workunit.client.0.trial155.stderr:adding another mon that is not yet online will not break quorum 2026-02-17T12:26:00.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:58: TEST_2_mons_checks: ceph mon ok-to-rm a 2026-02-17T12:26:00.838 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.a 2026-02-17T12:26:00.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:59: TEST_2_mons_checks: ceph mon ok-to-rm b 2026-02-17T12:26:00.936 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.b 2026-02-17T12:26:00.942 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:60: TEST_2_mons_checks: ceph mon ok-to-rm dne 2026-02-17T12:26:01.036 INFO:tasks.workunit.client.0.trial155.stderr:mon.dne does not exist 2026-02-17T12:26:01.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-17T12:26:01.042 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:01.042 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:01.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:01.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:01.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:01.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:01.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-17T12:26:01.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:26:01.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:26:01.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:26:01.150 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:01.150 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:01.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:01.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:01.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:01.155 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:01.156 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:26:01.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:26:01.157 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:26:01.157 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:26:01.157 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:26:01.158 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:26:01.159 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:01.159 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:26:01.159 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:26:01.159 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:01.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:26:01.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:26:01.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:26:01.163 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:26:01.163 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.163 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:26:01.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:26:01.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:26:01.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-17T12:26:01.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-17T12:26:01.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2026-02-17T12:26:01.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2026-02-17T12:26:01.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:26:01.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:26:01.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:26:01.166 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:01.166 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:01.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:01.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:01.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:01.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:01.167 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:26:01.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:26:01.168 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:26:01.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:26:01.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:26:01.169 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:26:01.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:01.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:26:01.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:26:01.170 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:01.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:26:01.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:26:01.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:26:01.173 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:26:01.173 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.173 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:26:01.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:26:01.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:26:01.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2026-02-17T12:26:01.175 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:26:01.176 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.176 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.62907 2026-02-17T12:26:01.177 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:26:01.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:26:01.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:26:01.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-17T12:26:01.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_3_mons_checks td/ok-to-stop 2026-02-17T12:26:01.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:64: TEST_3_mons_checks: local dir=td/ok-to-stop 2026-02-17T12:26:01.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:66: TEST_3_mons_checks: CEPH_ARGS='--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151,127.0.0.1:7152 ' 2026-02-17T12:26:01.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:68: TEST_3_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-17T12:26:01.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:01.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:01.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:26:01.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:01.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2026-02-17T12:26:01.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-17T12:26:01.198 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:01.198 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:01.198 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:01.198 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:01.198 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.198 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.198 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:01.198 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-17T12:26:01.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:01.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:26:01.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:01.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:26:01.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:01.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:01.225 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:26:01.225 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:26:01.225 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:26:01.226 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:01.226 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.226 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.226 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:26:01.226 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:01.226 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get fsid 2026-02-17T12:26:01.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:26:01.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:01.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:26:01.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:01.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:01.272 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:26:01.272 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:26:01.272 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:26:01.272 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:01.272 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.272 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.272 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:26:01.273 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:01.273 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get mon_host 2026-02-17T12:26:01.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:69: TEST_3_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2026-02-17T12:26:01.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:01.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:01.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2026-02-17T12:26:01.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:01.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/b 2026-02-17T12:26:01.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2026-02-17T12:26:01.334 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:01.335 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:01.335 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:01.335 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:01.335 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.335 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.335 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:01.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2026-02-17T12:26:01.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:01.361 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b fsid 2026-02-17T12:26:01.362 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:01.362 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:26:01.362 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:01.362 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:01.363 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:26:01.363 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:26:01.363 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:26:01.364 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:01.364 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.364 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.364 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.b.asok 2026-02-17T12:26:01.364 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:01.364 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.b.asok config get fsid 2026-02-17T12:26:01.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b mon_host 2026-02-17T12:26:01.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:01.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:26:01.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:01.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:01.413 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:26:01.413 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:26:01.413 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:26:01.413 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:01.413 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.413 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.413 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.b.asok 2026-02-17T12:26:01.413 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:01.413 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.b.asok config get mon_host 2026-02-17T12:26:01.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:70: TEST_3_mons_checks: run_mon td/ok-to-stop c --public-addr=127.0.0.1:7152 2026-02-17T12:26:01.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:01.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:01.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=c 2026-02-17T12:26:01.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:01.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/c 2026-02-17T12:26:01.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id c --mkfs --mon-data=td/ok-to-stop/c --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7152 2026-02-17T12:26:01.475 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:01.475 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:01.475 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:01.475 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:01.475 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.475 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.475 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:01.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/c '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7152 2026-02-17T12:26:01.500 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:01.501 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon c fsid 2026-02-17T12:26:01.501 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:01.501 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=c 2026-02-17T12:26:01.501 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:01.501 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:01.503 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.c 2026-02-17T12:26:01.503 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2026-02-17T12:26:01.503 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2026-02-17T12:26:01.503 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:01.503 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.503 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.503 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.c.asok 2026-02-17T12:26:01.503 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:01.503 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.c.asok config get fsid 2026-02-17T12:26:01.549 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon c mon_host 2026-02-17T12:26:01.549 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:01.549 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=c 2026-02-17T12:26:01.550 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:01.551 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:01.551 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.c 2026-02-17T12:26:01.551 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2026-02-17T12:26:01.551 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2026-02-17T12:26:01.551 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:01.551 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:01.551 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:01.552 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.c.asok 2026-02-17T12:26:01.552 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:01.552 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.c.asok config get mon_host 2026-02-17T12:26:01.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:71: TEST_3_mons_checks: wait_for_quorum 60 3 2026-02-17T12:26:01.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1055: wait_for_quorum: local timeout=60 2026-02-17T12:26:01.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1056: wait_for_quorum: local quorumsize=3 2026-02-17T12:26:01.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: [[ -z 60 ]] 2026-02-17T12:26:01.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: [[ -z 3 ]] 2026-02-17T12:26:01.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: wait_for_quorum: no_quorum=1 2026-02-17T12:26:01.596 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: date +%s 2026-02-17T12:26:01.597 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: wait_until=1771331221 2026-02-17T12:26:01.597 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:01.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331161 -lt 1771331221 ]] 2026-02-17T12:26:01.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:26:01.598 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:01.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:01.901 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:01.902 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:26:01.902 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:01.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=true 2026-02-17T12:26:01.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-17T12:26:01.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1074: wait_for_quorum: no_quorum=0 2026-02-17T12:26:01.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1075: wait_for_quorum: break 2026-02-17T12:26:01.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1078: wait_for_quorum: return 0 2026-02-17T12:26:01.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:73: TEST_3_mons_checks: ceph mon ok-to-stop dne 2026-02-17T12:26:01.999 INFO:tasks.workunit.client.0.trial155.stderr:invalid mon(s) specified: [dne] 2026-02-17T12:26:02.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:74: TEST_3_mons_checks: ceph mon ok-to-stop a 2026-02-17T12:26:02.097 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (b,c) after stopping [a] 2026-02-17T12:26:02.103 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:75: TEST_3_mons_checks: ceph mon ok-to-stop b 2026-02-17T12:26:02.197 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (a,c) after stopping [b] 2026-02-17T12:26:02.203 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:76: TEST_3_mons_checks: ceph mon ok-to-stop c 2026-02-17T12:26:02.295 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (a,b) after stopping [c] 2026-02-17T12:26:02.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:77: TEST_3_mons_checks: ceph mon ok-to-stop a b 2026-02-17T12:26:02.375 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (c) after stopping mons [a,b] 2026-02-17T12:26:02.377 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:78: TEST_3_mons_checks: ceph mon ok-to-stop b c 2026-02-17T12:26:02.452 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (a) after stopping mons [b,c] 2026-02-17T12:26:02.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:79: TEST_3_mons_checks: ceph mon ok-to-stop a b c 2026-02-17T12:26:02.527 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available () after stopping mons [a,b,c] 2026-02-17T12:26:02.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:81: TEST_3_mons_checks: ceph mon ok-to-add-offline 2026-02-17T12:26:02.620 INFO:tasks.workunit.client.0.trial155.stderr:adding another mon that is not yet online will not break quorum 2026-02-17T12:26:02.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:83: TEST_3_mons_checks: ceph mon ok-to-rm a 2026-02-17T12:26:02.718 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.a 2026-02-17T12:26:02.723 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:84: TEST_3_mons_checks: ceph mon ok-to-rm b 2026-02-17T12:26:02.813 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.b 2026-02-17T12:26:02.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:85: TEST_3_mons_checks: ceph mon ok-to-rm c 2026-02-17T12:26:02.910 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.c 2026-02-17T12:26:02.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:87: TEST_3_mons_checks: kill_daemons td/ok-to-stop KILL mon.b 2026-02-17T12:26:02.916 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:02.917 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:02.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:02.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:02.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:03.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:03.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:88: TEST_3_mons_checks: wait_for_quorum 60 2 2026-02-17T12:26:03.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1055: wait_for_quorum: local timeout=60 2026-02-17T12:26:03.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1056: wait_for_quorum: local quorumsize=2 2026-02-17T12:26:03.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: [[ -z 60 ]] 2026-02-17T12:26:03.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: [[ -z 2 ]] 2026-02-17T12:26:03.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: wait_for_quorum: no_quorum=1 2026-02-17T12:26:03.024 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: date +%s 2026-02-17T12:26:03.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: wait_until=1771331223 2026-02-17T12:26:03.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:03.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331163 -lt 1771331223 ]] 2026-02-17T12:26:03.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:03.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:06.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:06.126 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.127 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:06.127 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:06.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:06.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:06.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331166 -lt 1771331223 ]] 2026-02-17T12:26:06.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:06.130 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:06.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:06.230 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.230 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.231 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:06.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:06.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:06.232 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:06.233 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331166 -lt 1771331223 ]] 2026-02-17T12:26:06.233 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:06.234 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:06.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:06.332 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.332 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.333 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:06.334 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:06.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:06.335 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:06.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331166 -lt 1771331223 ]] 2026-02-17T12:26:06.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:06.336 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:06.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:06.436 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.437 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.437 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:06.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:06.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:06.439 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:06.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331166 -lt 1771331223 ]] 2026-02-17T12:26:06.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:06.440 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:06.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:06.541 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.542 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.542 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:06.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:06.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:06.544 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:06.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331166 -lt 1771331223 ]] 2026-02-17T12:26:06.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:06.545 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:06.646 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:06.646 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.647 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.647 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:06.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:06.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:06.649 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:06.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331166 -lt 1771331223 ]] 2026-02-17T12:26:06.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:06.650 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:06.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:06.752 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.753 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.753 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:06.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:06.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:06.755 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:06.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331166 -lt 1771331223 ]] 2026-02-17T12:26:06.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:06.756 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:06.855 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:06.855 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.856 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:06.856 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:06.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:06.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:06.858 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:06.859 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331166 -lt 1771331223 ]] 2026-02-17T12:26:06.859 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:06.859 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:09.959 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:09.959 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:09.960 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:09.960 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:09.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:09.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:09.962 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:09.962 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331169 -lt 1771331223 ]] 2026-02-17T12:26:09.962 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:09.963 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:10.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:10.064 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:10.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:10.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:10.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:10.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:10.067 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:10.068 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331170 -lt 1771331223 ]] 2026-02-17T12:26:10.068 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:10.068 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:10.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:10.166 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:10.166 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:10.166 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:10.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:10.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:10.168 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:10.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331170 -lt 1771331223 ]] 2026-02-17T12:26:10.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:10.170 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:10.267 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:10.267 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:10.267 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:10.267 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:10.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:10.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:10.269 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:10.270 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331170 -lt 1771331223 ]] 2026-02-17T12:26:10.270 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:10.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:10.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:10.374 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:10.374 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:10.374 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:10.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:10.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:10.376 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:10.377 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331170 -lt 1771331223 ]] 2026-02-17T12:26:10.377 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 2' 2026-02-17T12:26:10.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:19.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:19.484 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:19.485 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:01.190624Z","created":"2026-02-17T12:26:01.190624Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:19.485 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 2' 2026-02-17T12:26:19.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=true 2026-02-17T12:26:19.487 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-17T12:26:19.487 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1074: wait_for_quorum: no_quorum=0 2026-02-17T12:26:19.487 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1075: wait_for_quorum: break 2026-02-17T12:26:19.487 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1078: wait_for_quorum: return 0 2026-02-17T12:26:19.487 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:90: TEST_3_mons_checks: ceph mon ok-to-stop a 2026-02-17T12:26:19.561 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (c) after stopping mons [a] 2026-02-17T12:26:19.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:91: TEST_3_mons_checks: ceph mon ok-to-stop b 2026-02-17T12:26:19.657 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (a,c) after stopping [b] 2026-02-17T12:26:19.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:92: TEST_3_mons_checks: ceph mon ok-to-stop c 2026-02-17T12:26:19.736 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (a) after stopping mons [c] 2026-02-17T12:26:19.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:94: TEST_3_mons_checks: ceph mon ok-to-add-offline 2026-02-17T12:26:22.811 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: adding a monitor may break quorum (until that monitor starts) 2026-02-17T12:26:22.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:96: TEST_3_mons_checks: ceph mon ok-to-rm a 2026-02-17T12:26:22.886 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: removing mon.a would break quorum 2026-02-17T12:26:22.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:97: TEST_3_mons_checks: ceph mon ok-to-rm b 2026-02-17T12:26:25.981 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.b 2026-02-17T12:26:25.986 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:98: TEST_3_mons_checks: ceph mon ok-to-rm c 2026-02-17T12:26:26.061 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: removing mon.c would break quorum 2026-02-17T12:26:26.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-17T12:26:26.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:26.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:26.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:26.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:26.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:26.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:26.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-17T12:26:26.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:26:26.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:26:26.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:26:26.172 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:26.172 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:26.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:26.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:26.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:26.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:26.177 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:26:26.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:26:26.178 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:26:26.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:26:26.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:26:26.179 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:26:26.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:26.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:26:26.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:26:26.181 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:26.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:26:26.182 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:26:26.182 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:26:26.186 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:26:26.187 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.187 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:26:26.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:26:26.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:26:26.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-17T12:26:26.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-17T12:26:26.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2026-02-17T12:26:26.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2026-02-17T12:26:26.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:26:26.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:26:26.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:26:26.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:26.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:26.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:26.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:26.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:26.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:26.190 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:26:26.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:26:26.191 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:26:26.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:26:26.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:26:26.192 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:26:26.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:26.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:26:26.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:26:26.194 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:26.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:26:26.195 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:26:26.195 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:26:26.196 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:26:26.196 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.196 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:26:26.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:26:26.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:26:26.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2026-02-17T12:26:26.198 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:26:26.198 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.198 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.62907 2026-02-17T12:26:26.199 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:26:26.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:26:26.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:26:26.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-17T12:26:26.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_4_mons_checks td/ok-to-stop 2026-02-17T12:26:26.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:102: TEST_4_mons_checks: local dir=td/ok-to-stop 2026-02-17T12:26:26.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:104: TEST_4_mons_checks: CEPH_ARGS='--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151,127.0.0.1:7152,127.0.0.1:7153 ' 2026-02-17T12:26:26.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:106: TEST_4_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-17T12:26:26.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:26.202 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:26.202 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:26:26.202 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:26.202 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2026-02-17T12:26:26.202 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-17T12:26:26.219 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:26.220 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:26.220 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:26.220 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:26.220 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.220 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.220 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:26.220 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-17T12:26:26.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:26.247 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:26:26.247 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:26.247 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:26:26.247 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:26.247 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:26.248 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:26:26.248 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:26:26.248 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:26:26.249 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:26.249 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.249 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.249 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:26:26.249 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:26.249 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get fsid 2026-02-17T12:26:26.294 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:26:26.294 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:26.294 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:26:26.294 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:26.295 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:26.295 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:26:26.295 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:26:26.295 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:26:26.295 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:26.295 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.295 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.295 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:26:26.296 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:26.296 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get mon_host 2026-02-17T12:26:26.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:107: TEST_4_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2026-02-17T12:26:26.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:26.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:26.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2026-02-17T12:26:26.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:26.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/b 2026-02-17T12:26:26.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2026-02-17T12:26:26.356 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:26.356 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:26.356 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:26.356 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:26.356 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.357 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.357 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:26.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2026-02-17T12:26:26.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:26.383 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b fsid 2026-02-17T12:26:26.383 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:26.383 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:26:26.383 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:26.383 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:26.384 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:26:26.384 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:26:26.384 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:26:26.385 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:26.385 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.385 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.385 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.b.asok 2026-02-17T12:26:26.385 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:26.385 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.b.asok config get fsid 2026-02-17T12:26:26.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b mon_host 2026-02-17T12:26:26.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:26.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:26:26.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:26.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:26.432 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:26:26.432 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:26:26.432 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:26:26.432 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:26.432 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.432 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.432 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.b.asok 2026-02-17T12:26:26.432 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:26.432 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.b.asok config get mon_host 2026-02-17T12:26:26.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:108: TEST_4_mons_checks: run_mon td/ok-to-stop c --public-addr=127.0.0.1:7152 2026-02-17T12:26:26.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:26.477 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:26.477 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=c 2026-02-17T12:26:26.477 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:26.477 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/c 2026-02-17T12:26:26.477 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id c --mkfs --mon-data=td/ok-to-stop/c --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7152 2026-02-17T12:26:26.496 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:26.496 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:26.496 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:26.496 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:26.496 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.496 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.496 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:26.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/c '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7152 2026-02-17T12:26:26.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:26.521 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon c fsid 2026-02-17T12:26:26.521 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:26.521 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=c 2026-02-17T12:26:26.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:26.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:26.522 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.c 2026-02-17T12:26:26.522 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2026-02-17T12:26:26.522 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2026-02-17T12:26:26.522 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:26.522 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.522 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.523 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.c.asok 2026-02-17T12:26:26.523 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:26.523 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.c.asok config get fsid 2026-02-17T12:26:26.569 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon c mon_host 2026-02-17T12:26:26.569 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:26.569 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=c 2026-02-17T12:26:26.569 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:26.569 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:26.570 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.c 2026-02-17T12:26:26.570 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2026-02-17T12:26:26.570 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2026-02-17T12:26:26.570 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:26.570 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.570 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.570 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.c.asok 2026-02-17T12:26:26.570 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:26.571 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.c.asok config get mon_host 2026-02-17T12:26:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:109: TEST_4_mons_checks: run_mon td/ok-to-stop d --public-addr=127.0.0.1:7153 2026-02-17T12:26:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=d 2026-02-17T12:26:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/d 2026-02-17T12:26:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id d --mkfs --mon-data=td/ok-to-stop/d --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7153 2026-02-17T12:26:26.633 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:26.633 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:26.633 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:26.633 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:26.633 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.633 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.633 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:26.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id d --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/d '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7153 2026-02-17T12:26:26.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:26.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon d fsid 2026-02-17T12:26:26.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:26.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=d 2026-02-17T12:26:26.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:26.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:26.660 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.d 2026-02-17T12:26:26.660 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.d 2026-02-17T12:26:26.661 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.d ']' 2026-02-17T12:26:26.661 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:26.662 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.662 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.662 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.d.asok 2026-02-17T12:26:26.662 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:26.662 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.d.asok config get fsid 2026-02-17T12:26:26.706 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon d mon_host 2026-02-17T12:26:26.706 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:26.706 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=d 2026-02-17T12:26:26.706 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:26.706 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:26.707 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.d 2026-02-17T12:26:26.707 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.d 2026-02-17T12:26:26.707 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.d ']' 2026-02-17T12:26:26.708 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:26.708 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:26.708 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:26.708 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.d.asok 2026-02-17T12:26:26.708 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:26.708 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.d.asok config get mon_host 2026-02-17T12:26:26.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:110: TEST_4_mons_checks: wait_for_quorum 60 4 2026-02-17T12:26:26.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1055: wait_for_quorum: local timeout=60 2026-02-17T12:26:26.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1056: wait_for_quorum: local quorumsize=4 2026-02-17T12:26:26.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: [[ -z 60 ]] 2026-02-17T12:26:26.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: [[ -z 4 ]] 2026-02-17T12:26:26.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: wait_for_quorum: no_quorum=1 2026-02-17T12:26:26.751 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: date +%s 2026-02-17T12:26:26.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: wait_until=1771331246 2026-02-17T12:26:26.752 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:26.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331186 -lt 1771331246 ]] 2026-02-17T12:26:26.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-17T12:26:26.753 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:27.056 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:27.056 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:27.057 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:27.057 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 4' 2026-02-17T12:26:27.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=true 2026-02-17T12:26:27.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-17T12:26:27.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1074: wait_for_quorum: no_quorum=0 2026-02-17T12:26:27.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1075: wait_for_quorum: break 2026-02-17T12:26:27.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1078: wait_for_quorum: return 0 2026-02-17T12:26:27.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:112: TEST_4_mons_checks: ceph mon ok-to-stop dne 2026-02-17T12:26:27.155 INFO:tasks.workunit.client.0.trial155.stderr:invalid mon(s) specified: [dne] 2026-02-17T12:26:27.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:113: TEST_4_mons_checks: ceph mon ok-to-stop a 2026-02-17T12:26:27.251 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (b,c,d) after stopping [a] 2026-02-17T12:26:27.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:114: TEST_4_mons_checks: ceph mon ok-to-stop b 2026-02-17T12:26:27.352 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (a,c,d) after stopping [b] 2026-02-17T12:26:27.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:115: TEST_4_mons_checks: ceph mon ok-to-stop c 2026-02-17T12:26:27.452 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (a,b,d) after stopping [c] 2026-02-17T12:26:27.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:116: TEST_4_mons_checks: ceph mon ok-to-stop d 2026-02-17T12:26:27.550 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (a,b,c) after stopping [d] 2026-02-17T12:26:27.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:117: TEST_4_mons_checks: ceph mon ok-to-stop a b 2026-02-17T12:26:27.631 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (c,d) after stopping mons [a,b] 2026-02-17T12:26:27.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:118: TEST_4_mons_checks: ceph mon ok-to-stop c d 2026-02-17T12:26:27.710 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (a,b) after stopping mons [c,d] 2026-02-17T12:26:27.712 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:120: TEST_4_mons_checks: ceph mon ok-to-add-offline 2026-02-17T12:26:27.806 INFO:tasks.workunit.client.0.trial155.stderr:adding another mon that is not yet online will not break quorum 2026-02-17T12:26:27.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:122: TEST_4_mons_checks: ceph mon ok-to-rm a 2026-02-17T12:26:27.908 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.a 2026-02-17T12:26:27.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:123: TEST_4_mons_checks: ceph mon ok-to-rm b 2026-02-17T12:26:28.008 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.b 2026-02-17T12:26:28.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:124: TEST_4_mons_checks: ceph mon ok-to-rm c 2026-02-17T12:26:28.108 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.c 2026-02-17T12:26:28.114 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:126: TEST_4_mons_checks: kill_daemons td/ok-to-stop KILL mon.a 2026-02-17T12:26:28.115 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:28.115 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:28.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:28.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:28.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:28.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:28.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:127: TEST_4_mons_checks: wait_for_quorum 60 3 2026-02-17T12:26:28.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1055: wait_for_quorum: local timeout=60 2026-02-17T12:26:28.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1056: wait_for_quorum: local quorumsize=3 2026-02-17T12:26:28.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: [[ -z 60 ]] 2026-02-17T12:26:28.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: [[ -z 3 ]] 2026-02-17T12:26:28.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: wait_for_quorum: no_quorum=1 2026-02-17T12:26:28.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: date +%s 2026-02-17T12:26:28.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: wait_until=1771331248 2026-02-17T12:26:28.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:28.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331188 -lt 1771331248 ]] 2026-02-17T12:26:28.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:26:28.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:28.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:28.324 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:28.324 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:28.325 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:26:28.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:28.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:28.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:28.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331188 -lt 1771331248 ]] 2026-02-17T12:26:28.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:26:28.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:28.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:28.430 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:28.430 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:28.430 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:26:28.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:28.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:28.432 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:28.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331188 -lt 1771331248 ]] 2026-02-17T12:26:28.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:26:28.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:31.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:31.533 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:31.533 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:26:31.533 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:31.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:31.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:31.535 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:31.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331191 -lt 1771331248 ]] 2026-02-17T12:26:31.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:26:31.536 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:31.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:31.635 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:31.636 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:31.636 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:26:31.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:31.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:31.637 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:31.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331191 -lt 1771331248 ]] 2026-02-17T12:26:31.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:26:31.639 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:34.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:34.745 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:34.746 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:34.746 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:26:34.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:34.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:34.747 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:34.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331194 -lt 1771331248 ]] 2026-02-17T12:26:34.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:26:34.749 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:34.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:34.850 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:34.850 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:34.850 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:26:34.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:34.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:34.852 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:34.853 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331194 -lt 1771331248 ]] 2026-02-17T12:26:34.853 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:26:34.854 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:34.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:34.954 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:34.954 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:26:34.955 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:34.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:34.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:34.956 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:34.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331194 -lt 1771331248 ]] 2026-02-17T12:26:34.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:26:34.957 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:35.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:35.061 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:35.062 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:35.062 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:26:35.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:35.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:35.064 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:35.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331195 -lt 1771331248 ]] 2026-02-17T12:26:35.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:26:35.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:35.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:35.165 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:35.166 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:35.166 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:26:35.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:26:35.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:26:35.168 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:35.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331195 -lt 1771331248 ]] 2026-02-17T12:26:35.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:26:35.169 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:44.272 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:44.272 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":6,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:44.273 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:26:44.273 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:26.212667Z","created":"2026-02-17T12:26:26.212667Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:44.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=true 2026-02-17T12:26:44.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-17T12:26:44.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1074: wait_for_quorum: no_quorum=0 2026-02-17T12:26:44.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1075: wait_for_quorum: break 2026-02-17T12:26:44.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1078: wait_for_quorum: return 0 2026-02-17T12:26:44.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:129: TEST_4_mons_checks: ceph mon ok-to-stop a 2026-02-17T12:26:44.367 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (b,c,d) after stopping [a] 2026-02-17T12:26:44.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:130: TEST_4_mons_checks: ceph mon ok-to-stop b 2026-02-17T12:26:44.447 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (c,d) after stopping mons [b] 2026-02-17T12:26:44.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:131: TEST_4_mons_checks: ceph mon ok-to-stop c 2026-02-17T12:26:47.525 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (b,d) after stopping mons [c] 2026-02-17T12:26:47.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:132: TEST_4_mons_checks: ceph mon ok-to-stop d 2026-02-17T12:26:47.600 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (b,c) after stopping mons [d] 2026-02-17T12:26:47.602 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:134: TEST_4_mons_checks: ceph mon ok-to-add-offline 2026-02-17T12:26:47.693 INFO:tasks.workunit.client.0.trial155.stderr:adding another mon that is not yet online will not break quorum 2026-02-17T12:26:47.698 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:136: TEST_4_mons_checks: ceph mon ok-to-rm a 2026-02-17T12:26:47.793 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.a 2026-02-17T12:26:47.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:137: TEST_4_mons_checks: ceph mon ok-to-rm b 2026-02-17T12:26:47.893 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.b 2026-02-17T12:26:47.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:138: TEST_4_mons_checks: ceph mon ok-to-rm c 2026-02-17T12:26:47.991 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.c 2026-02-17T12:26:47.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:139: TEST_4_mons_checks: ceph mon ok-to-rm d 2026-02-17T12:26:48.090 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.d 2026-02-17T12:26:48.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-17T12:26:48.096 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:48.096 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:48.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:48.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:48.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:48.203 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:48.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-17T12:26:48.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:26:48.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:26:48.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:26:48.204 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:48.204 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:48.205 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:48.205 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:48.205 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:48.210 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:48.210 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:26:48.211 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:26:48.211 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:26:48.212 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:26:48.212 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:26:48.212 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:26:48.213 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:48.213 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:26:48.214 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:26:48.214 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:48.214 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:26:48.215 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:26:48.215 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:26:48.220 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:26:48.220 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.220 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.220 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:26:48.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:26:48.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:26:48.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2026-02-17T12:26:48.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2026-02-17T12:26:48.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2026-02-17T12:26:48.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2026-02-17T12:26:48.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:26:48.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:26:48.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:26:48.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:26:48.222 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:26:48.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:26:48.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:26:48.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:26:48.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:26:48.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:26:48.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:26:48.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:26:48.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:26:48.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:26:48.226 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:26:48.226 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:48.226 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:26:48.227 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:26:48.227 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:26:48.227 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:26:48.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:26:48.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:26:48.229 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:26:48.230 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.230 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:26:48.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:26:48.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:26:48.231 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2026-02-17T12:26:48.232 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:26:48.232 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.232 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.62907 2026-02-17T12:26:48.233 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:26:48.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:26:48.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:26:48.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2026-02-17T12:26:48.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_5_mons_checks td/ok-to-stop 2026-02-17T12:26:48.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:143: TEST_5_mons_checks: local dir=td/ok-to-stop 2026-02-17T12:26:48.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:145: TEST_5_mons_checks: CEPH_ARGS='--fsid=9b71c295-4c6c-4493-8d5c-a9a59991858e --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151,127.0.0.1:7152,127.0.0.1:7153,127.0.0.1:7154 ' 2026-02-17T12:26:48.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:147: TEST_5_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2026-02-17T12:26:48.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:48.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:48.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:26:48.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:48.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2026-02-17T12:26:48.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2026-02-17T12:26:48.253 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:48.254 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:48.254 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:48.254 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:48.254 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.254 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.254 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:48.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2026-02-17T12:26:48.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:48.279 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:26:48.280 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:48.280 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:26:48.280 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:48.280 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:48.281 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:26:48.281 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:26:48.281 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:26:48.281 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:48.281 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.281 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.282 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:26:48.282 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:48.282 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get fsid 2026-02-17T12:26:48.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:26:48.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:48.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:26:48.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:48.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:48.327 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:26:48.328 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:26:48.328 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:26:48.328 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:48.328 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.328 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.328 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.a.asok 2026-02-17T12:26:48.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:48.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.a.asok config get mon_host 2026-02-17T12:26:48.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:148: TEST_5_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2026-02-17T12:26:48.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:48.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:48.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2026-02-17T12:26:48.372 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:48.372 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/b 2026-02-17T12:26:48.372 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2026-02-17T12:26:48.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:48.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:48.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:48.390 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:48.391 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.391 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.391 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:48.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2026-02-17T12:26:48.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:48.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b fsid 2026-02-17T12:26:48.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:48.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:26:48.418 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:48.418 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:48.419 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:26:48.419 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:26:48.419 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:26:48.419 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:48.419 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.419 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.419 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.b.asok 2026-02-17T12:26:48.420 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:48.420 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.b.asok config get fsid 2026-02-17T12:26:48.464 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b mon_host 2026-02-17T12:26:48.464 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:48.464 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:26:48.464 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:48.464 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:48.464 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:26:48.464 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:26:48.464 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:26:48.465 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:48.465 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.466 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.466 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.b.asok 2026-02-17T12:26:48.466 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:48.466 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.b.asok config get mon_host 2026-02-17T12:26:48.509 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:149: TEST_5_mons_checks: run_mon td/ok-to-stop c --public-addr=127.0.0.1:7152 2026-02-17T12:26:48.509 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:48.509 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:48.509 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=c 2026-02-17T12:26:48.509 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:48.509 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/c 2026-02-17T12:26:48.509 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id c --mkfs --mon-data=td/ok-to-stop/c --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7152 2026-02-17T12:26:48.527 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:48.527 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:48.528 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:48.528 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:48.528 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.528 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.528 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:48.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/c '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7152 2026-02-17T12:26:48.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:48.554 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon c fsid 2026-02-17T12:26:48.554 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:48.554 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=c 2026-02-17T12:26:48.555 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:48.555 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:48.556 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.c 2026-02-17T12:26:48.556 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2026-02-17T12:26:48.556 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2026-02-17T12:26:48.556 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:48.556 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.556 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.556 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.c.asok 2026-02-17T12:26:48.556 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:48.557 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.c.asok config get fsid 2026-02-17T12:26:48.599 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon c mon_host 2026-02-17T12:26:48.600 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:48.600 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=c 2026-02-17T12:26:48.600 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:48.600 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:48.601 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.c 2026-02-17T12:26:48.601 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2026-02-17T12:26:48.601 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2026-02-17T12:26:48.601 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:48.601 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.602 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.602 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.c.asok 2026-02-17T12:26:48.602 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:48.602 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.c.asok config get mon_host 2026-02-17T12:26:48.644 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:150: TEST_5_mons_checks: run_mon td/ok-to-stop d --public-addr=127.0.0.1:7153 2026-02-17T12:26:48.645 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:48.645 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:48.645 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=d 2026-02-17T12:26:48.645 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:48.645 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/d 2026-02-17T12:26:48.645 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id d --mkfs --mon-data=td/ok-to-stop/d --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7153 2026-02-17T12:26:48.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:48.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:48.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:48.663 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:48.663 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.663 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:48.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id d --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/d '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7153 2026-02-17T12:26:48.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:48.690 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon d fsid 2026-02-17T12:26:48.690 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:48.690 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=d 2026-02-17T12:26:48.690 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:48.690 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:48.690 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.d 2026-02-17T12:26:48.690 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.d 2026-02-17T12:26:48.691 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.d ']' 2026-02-17T12:26:48.691 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:48.692 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.692 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.692 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.d.asok 2026-02-17T12:26:48.692 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:48.692 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.d.asok config get fsid 2026-02-17T12:26:48.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon d mon_host 2026-02-17T12:26:48.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:48.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=d 2026-02-17T12:26:48.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:48.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:48.736 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.d 2026-02-17T12:26:48.737 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.d 2026-02-17T12:26:48.737 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.d ']' 2026-02-17T12:26:48.737 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:48.738 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.738 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.738 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.d.asok 2026-02-17T12:26:48.738 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:48.738 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.d.asok config get mon_host 2026-02-17T12:26:48.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:151: TEST_5_mons_checks: run_mon td/ok-to-stop e --public-addr=127.0.0.1:7154 2026-02-17T12:26:48.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2026-02-17T12:26:48.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:26:48.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=e 2026-02-17T12:26:48.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:26:48.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/e 2026-02-17T12:26:48.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id e --mkfs --mon-data=td/ok-to-stop/e --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7154 2026-02-17T12:26:48.800 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:26:48.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:26:48.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:26:48.801 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:26:48.801 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.801 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.62907/$cluster-$name.asok' 2026-02-17T12:26:48.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id e --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/e '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.62907/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7154 2026-02-17T12:26:48.826 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:26:48.827 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon e fsid 2026-02-17T12:26:48.827 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:48.827 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=e 2026-02-17T12:26:48.827 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:26:48.829 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.e 2026-02-17T12:26:48.829 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.e 2026-02-17T12:26:48.829 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.e ']' 2026-02-17T12:26:48.829 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:48.829 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.829 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.829 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.e.asok 2026-02-17T12:26:48.829 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:48.829 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.e.asok config get fsid 2026-02-17T12:26:48.829 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:26:48.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon e mon_host 2026-02-17T12:26:48.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:26:48.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=e 2026-02-17T12:26:48.874 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:26:48.874 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:26:48.875 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.e 2026-02-17T12:26:48.875 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.e 2026-02-17T12:26:48.875 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.e ']' 2026-02-17T12:26:48.875 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:26:48.875 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:26:48.875 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:26:48.875 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.62907/ceph-mon.e.asok 2026-02-17T12:26:48.875 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:26:48.876 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.62907/ceph-mon.e.asok config get mon_host 2026-02-17T12:26:48.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:152: TEST_5_mons_checks: wait_for_quorum 60 5 2026-02-17T12:26:48.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1055: wait_for_quorum: local timeout=60 2026-02-17T12:26:48.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1056: wait_for_quorum: local quorumsize=5 2026-02-17T12:26:48.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: [[ -z 60 ]] 2026-02-17T12:26:48.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: [[ -z 5 ]] 2026-02-17T12:26:48.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: wait_for_quorum: no_quorum=1 2026-02-17T12:26:48.921 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: date +%s 2026-02-17T12:26:48.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: wait_until=1771331268 2026-02-17T12:26:48.921 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:26:48.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331208 -lt 1771331268 ]] 2026-02-17T12:26:48.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 5' 2026-02-17T12:26:48.922 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:26:59.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:26:59.430 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:59.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:26:59.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 5' 2026-02-17T12:26:59.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=true 2026-02-17T12:26:59.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-17T12:26:59.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1074: wait_for_quorum: no_quorum=0 2026-02-17T12:26:59.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1075: wait_for_quorum: break 2026-02-17T12:26:59.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1078: wait_for_quorum: return 0 2026-02-17T12:26:59.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:154: TEST_5_mons_checks: ceph mon ok-to-stop dne 2026-02-17T12:26:59.526 INFO:tasks.workunit.client.0.trial155.stderr:invalid mon(s) specified: [dne] 2026-02-17T12:26:59.531 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:155: TEST_5_mons_checks: ceph mon ok-to-stop a 2026-02-17T12:27:02.628 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (b,c,d,e) after stopping [a] 2026-02-17T12:27:02.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:156: TEST_5_mons_checks: ceph mon ok-to-stop b 2026-02-17T12:27:05.728 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (a,c,d,e) after stopping [b] 2026-02-17T12:27:05.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:157: TEST_5_mons_checks: ceph mon ok-to-stop c 2026-02-17T12:27:05.827 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (a,b,d,e) after stopping [c] 2026-02-17T12:27:05.832 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:158: TEST_5_mons_checks: ceph mon ok-to-stop d 2026-02-17T12:27:05.925 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (a,b,c,e) after stopping [d] 2026-02-17T12:27:05.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:159: TEST_5_mons_checks: ceph mon ok-to-stop e 2026-02-17T12:27:09.024 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (a,b,c,d) after stopping [e] 2026-02-17T12:27:09.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:160: TEST_5_mons_checks: ceph mon ok-to-stop a b 2026-02-17T12:27:12.123 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (c,d,e) after stopping [a,b] 2026-02-17T12:27:12.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:161: TEST_5_mons_checks: ceph mon ok-to-stop c d 2026-02-17T12:27:12.223 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (a,b,e) after stopping [c,d] 2026-02-17T12:27:12.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:162: TEST_5_mons_checks: ceph mon ok-to-stop a b c 2026-02-17T12:27:12.304 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (d,e) after stopping mons [a,b,c] 2026-02-17T12:27:12.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:164: TEST_5_mons_checks: ceph mon ok-to-add-offline 2026-02-17T12:27:12.399 INFO:tasks.workunit.client.0.trial155.stderr:adding another mon that is not yet online will not break quorum 2026-02-17T12:27:12.404 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:166: TEST_5_mons_checks: ceph mon ok-to-rm a 2026-02-17T12:27:12.498 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.a 2026-02-17T12:27:12.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:167: TEST_5_mons_checks: ceph mon ok-to-rm b 2026-02-17T12:27:12.597 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.b 2026-02-17T12:27:12.603 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:168: TEST_5_mons_checks: ceph mon ok-to-rm c 2026-02-17T12:27:12.696 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.c 2026-02-17T12:27:12.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:169: TEST_5_mons_checks: ceph mon ok-to-rm d 2026-02-17T12:27:12.794 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.d 2026-02-17T12:27:12.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:170: TEST_5_mons_checks: ceph mon ok-to-rm e 2026-02-17T12:27:12.891 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.e 2026-02-17T12:27:12.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:172: TEST_5_mons_checks: kill_daemons td/ok-to-stop KILL mon.a 2026-02-17T12:27:12.898 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:27:12.898 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:27:12.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:27:12.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:27:12.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:27:13.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:27:13.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:173: TEST_5_mons_checks: wait_for_quorum 60 4 2026-02-17T12:27:13.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1055: wait_for_quorum: local timeout=60 2026-02-17T12:27:13.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1056: wait_for_quorum: local quorumsize=4 2026-02-17T12:27:13.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: [[ -z 60 ]] 2026-02-17T12:27:13.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: [[ -z 4 ]] 2026-02-17T12:27:13.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: wait_for_quorum: no_quorum=1 2026-02-17T12:27:13.005 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: date +%s 2026-02-17T12:27:13.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: wait_until=1771331293 2026-02-17T12:27:13.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:13.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331233 -lt 1771331293 ]] 2026-02-17T12:27:13.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-17T12:27:13.007 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:16.110 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:16.110 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:16.111 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 4' 2026-02-17T12:27:16.111 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:16.113 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:16.113 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:16.113 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:16.114 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331236 -lt 1771331293 ]] 2026-02-17T12:27:16.114 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-17T12:27:16.114 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:16.212 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:16.213 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:16.213 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 4' 2026-02-17T12:27:16.213 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:16.215 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:16.215 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:16.215 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:16.216 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331236 -lt 1771331293 ]] 2026-02-17T12:27:16.216 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-17T12:27:16.216 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:16.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:16.316 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:16.316 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 4' 2026-02-17T12:27:16.316 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:16.318 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:16.318 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:16.318 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:16.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331236 -lt 1771331293 ]] 2026-02-17T12:27:16.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-17T12:27:16.320 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:16.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:16.417 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:16.418 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:16.418 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 4' 2026-02-17T12:27:16.420 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:16.420 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:16.420 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:16.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331236 -lt 1771331293 ]] 2026-02-17T12:27:16.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-17T12:27:16.421 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:19.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:19.523 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:19.523 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 4' 2026-02-17T12:27:19.523 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:19.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:19.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:19.525 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:19.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331239 -lt 1771331293 ]] 2026-02-17T12:27:19.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-17T12:27:19.526 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:22.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:22.628 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:22.629 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:22.629 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 4' 2026-02-17T12:27:22.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:22.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:22.631 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:22.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331242 -lt 1771331293 ]] 2026-02-17T12:27:22.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-17T12:27:22.632 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:22.731 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:22.731 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:22.732 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 4' 2026-02-17T12:27:22.732 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:22.733 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:22.733 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:22.734 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:22.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331242 -lt 1771331293 ]] 2026-02-17T12:27:22.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-17T12:27:22.735 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:22.836 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:22.836 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:22.837 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":6,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:22.838 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 4' 2026-02-17T12:27:22.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:22.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:22.839 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:22.840 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331242 -lt 1771331293 ]] 2026-02-17T12:27:22.840 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 4' 2026-02-17T12:27:22.841 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:28.946 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:28.946 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:28.947 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:28.947 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 4' 2026-02-17T12:27:28.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=true 2026-02-17T12:27:28.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-17T12:27:28.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1074: wait_for_quorum: no_quorum=0 2026-02-17T12:27:28.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1075: wait_for_quorum: break 2026-02-17T12:27:28.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1078: wait_for_quorum: return 0 2026-02-17T12:27:28.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:175: TEST_5_mons_checks: ceph mon ok-to-stop a 2026-02-17T12:27:32.047 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (b,c,d,e) after stopping [a] 2026-02-17T12:27:32.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:176: TEST_5_mons_checks: ceph mon ok-to-stop b 2026-02-17T12:27:32.147 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (c,d,e) after stopping [b] 2026-02-17T12:27:32.153 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:177: TEST_5_mons_checks: ceph mon ok-to-stop c 2026-02-17T12:27:32.248 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (b,d,e) after stopping [c] 2026-02-17T12:27:32.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:178: TEST_5_mons_checks: ceph mon ok-to-stop d 2026-02-17T12:27:32.344 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (b,c,e) after stopping [d] 2026-02-17T12:27:32.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:179: TEST_5_mons_checks: ceph mon ok-to-stop e 2026-02-17T12:27:32.442 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (b,c,d) after stopping [e] 2026-02-17T12:27:32.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:181: TEST_5_mons_checks: ceph mon ok-to-add-offline 2026-02-17T12:27:32.543 INFO:tasks.workunit.client.0.trial155.stderr:adding another mon that is not yet online will not break quorum 2026-02-17T12:27:32.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:183: TEST_5_mons_checks: ceph mon ok-to-rm a 2026-02-17T12:27:32.642 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.a 2026-02-17T12:27:32.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:184: TEST_5_mons_checks: ceph mon ok-to-rm b 2026-02-17T12:27:32.741 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.b 2026-02-17T12:27:32.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:185: TEST_5_mons_checks: ceph mon ok-to-rm c 2026-02-17T12:27:32.840 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.c 2026-02-17T12:27:32.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:186: TEST_5_mons_checks: ceph mon ok-to-rm d 2026-02-17T12:27:32.938 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.d 2026-02-17T12:27:32.943 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:187: TEST_5_mons_checks: ceph mon ok-to-rm e 2026-02-17T12:27:33.037 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.e 2026-02-17T12:27:33.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:189: TEST_5_mons_checks: kill_daemons td/ok-to-stop KILL mon.e 2026-02-17T12:27:33.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:27:33.044 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:27:33.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:27:33.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:27:33.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:27:33.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:27:33.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:190: TEST_5_mons_checks: wait_for_quorum 60 3 2026-02-17T12:27:33.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1055: wait_for_quorum: local timeout=60 2026-02-17T12:27:33.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1056: wait_for_quorum: local quorumsize=3 2026-02-17T12:27:33.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: [[ -z 60 ]] 2026-02-17T12:27:33.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: [[ -z 3 ]] 2026-02-17T12:27:33.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: wait_for_quorum: no_quorum=1 2026-02-17T12:27:33.150 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: date +%s 2026-02-17T12:27:33.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: wait_for_quorum: wait_until=1771331313 2026-02-17T12:27:33.151 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:33.152 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331253 -lt 1771331313 ]] 2026-02-17T12:27:33.152 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:33.153 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:33.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:33.254 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.254 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:33.254 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:33.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:33.256 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:33.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331253 -lt 1771331313 ]] 2026-02-17T12:27:33.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:33.258 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:33.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:33.359 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.360 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.360 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:33.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:33.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:33.361 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:33.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331253 -lt 1771331313 ]] 2026-02-17T12:27:33.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:33.363 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:33.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:33.461 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.461 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.462 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:33.464 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:33.464 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:33.464 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:33.465 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331253 -lt 1771331313 ]] 2026-02-17T12:27:33.465 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:33.465 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:33.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:33.563 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.564 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:33.564 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:33.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:33.566 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:33.567 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331253 -lt 1771331313 ]] 2026-02-17T12:27:33.567 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:33.567 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:33.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:33.665 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.666 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.666 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:33.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:33.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:33.668 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:33.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331253 -lt 1771331313 ]] 2026-02-17T12:27:33.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:33.669 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:33.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:33.766 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.766 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:33.767 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:33.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:33.768 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:33.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331253 -lt 1771331313 ]] 2026-02-17T12:27:33.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:33.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:33.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:33.871 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.871 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.871 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:33.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:33.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:33.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:33.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331253 -lt 1771331313 ]] 2026-02-17T12:27:33.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:33.874 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:33.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:33.976 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:33.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:33.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:33.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:33.978 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:33.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331253 -lt 1771331313 ]] 2026-02-17T12:27:33.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:33.979 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:37.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:37.082 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:37.083 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:37.083 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:37.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:37.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:37.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:37.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331257 -lt 1771331313 ]] 2026-02-17T12:27:37.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:37.086 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:37.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:37.186 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:37.186 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:37.187 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:37.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:37.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:37.188 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:37.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331257 -lt 1771331313 ]] 2026-02-17T12:27:37.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:37.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:37.286 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:37.287 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:37.287 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:37.287 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:37.289 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:37.289 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:37.290 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:37.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331257 -lt 1771331313 ]] 2026-02-17T12:27:37.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:37.291 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:40.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:40.392 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.392 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.393 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:40.394 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:40.394 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:40.394 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:40.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331260 -lt 1771331313 ]] 2026-02-17T12:27:40.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:40.396 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:40.494 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:40.495 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.495 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.495 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:40.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:40.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:40.497 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:40.498 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331260 -lt 1771331313 ]] 2026-02-17T12:27:40.498 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:40.498 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:40.597 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:40.597 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.598 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:40.598 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.599 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:40.600 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:40.600 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:40.601 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331260 -lt 1771331313 ]] 2026-02-17T12:27:40.601 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:40.601 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:40.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:40.702 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.703 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.703 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:40.705 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:40.705 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:40.705 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:40.706 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331260 -lt 1771331313 ]] 2026-02-17T12:27:40.706 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:40.706 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:40.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:40.807 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:40.808 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:40.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:40.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:40.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331260 -lt 1771331313 ]] 2026-02-17T12:27:40.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:40.811 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:40.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:40.912 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.913 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:40.913 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:40.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:40.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:40.915 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:40.916 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331260 -lt 1771331313 ]] 2026-02-17T12:27:40.916 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:40.916 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:41.017 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:41.017 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:41.018 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:41.018 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:41.020 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:41.020 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:41.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:41.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331261 -lt 1771331313 ]] 2026-02-17T12:27:41.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:41.022 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:41.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:41.121 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:41.121 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:41.121 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":8,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:41.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=false 2026-02-17T12:27:41.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ false == \t\r\u\e ]] 2026-02-17T12:27:41.123 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: date +%s 2026-02-17T12:27:41.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: [[ 1771331261 -lt 1771331313 ]] 2026-02-17T12:27:41.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: wait_for_quorum: jqfilter='.quorum | length == 3' 2026-02-17T12:27:41.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2026-02-17T12:27:48.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1071: wait_for_quorum: jqinput=' 2026-02-17T12:27:48.628 INFO:tasks.workunit.client.0.trial155.stderr:{"election_epoch":12,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:48.629 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: jq '.quorum | length == 3' 2026-02-17T12:27:48.629 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: echo '{"election_epoch":12,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9b71c295-4c6c-4493-8d5c-a9a59991858e","modified":"2026-02-17T12:26:48.246977Z","created":"2026-02-17T12:26:48.246977Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2026-02-17T12:27:48.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1072: wait_for_quorum: res=true 2026-02-17T12:27:48.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1073: wait_for_quorum: [[ true == \t\r\u\e ]] 2026-02-17T12:27:48.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1074: wait_for_quorum: no_quorum=0 2026-02-17T12:27:48.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1075: wait_for_quorum: break 2026-02-17T12:27:48.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1078: wait_for_quorum: return 0 2026-02-17T12:27:48.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:192: TEST_5_mons_checks: ceph mon ok-to-stop a 2026-02-17T12:27:48.724 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (b,c,d) after stopping [a] 2026-02-17T12:27:48.730 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:193: TEST_5_mons_checks: ceph mon ok-to-stop b 2026-02-17T12:27:48.804 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (c,d) after stopping mons [b] 2026-02-17T12:27:48.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:194: TEST_5_mons_checks: ceph mon ok-to-stop c 2026-02-17T12:27:48.882 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (b,d) after stopping mons [c] 2026-02-17T12:27:48.884 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:195: TEST_5_mons_checks: ceph mon ok-to-stop d 2026-02-17T12:27:48.961 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: not enough monitors would be available (b,c) after stopping mons [d] 2026-02-17T12:27:48.963 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:196: TEST_5_mons_checks: ceph mon ok-to-stop e 2026-02-17T12:27:49.059 INFO:tasks.workunit.client.0.trial155.stderr:quorum should be preserved (b,c,d) after stopping [e] 2026-02-17T12:27:49.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:198: TEST_5_mons_checks: ceph mon ok-to-add-offline 2026-02-17T12:27:49.138 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: adding a monitor may break quorum (until that monitor starts) 2026-02-17T12:27:49.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:200: TEST_5_mons_checks: ceph mon ok-to-rm a 2026-02-17T12:27:49.232 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.a 2026-02-17T12:27:49.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:201: TEST_5_mons_checks: ceph mon ok-to-rm b 2026-02-17T12:27:55.312 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: removing mon.b would break quorum 2026-02-17T12:27:55.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:202: TEST_5_mons_checks: ceph mon ok-to-rm c 2026-02-17T12:27:58.390 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: removing mon.c would break quorum 2026-02-17T12:27:58.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:203: TEST_5_mons_checks: ceph mon ok-to-rm d 2026-02-17T12:27:58.467 INFO:tasks.workunit.client.0.trial155.stderr:Error EBUSY: removing mon.d would break quorum 2026-02-17T12:27:58.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:204: TEST_5_mons_checks: ceph mon ok-to-rm e 2026-02-17T12:28:01.560 INFO:tasks.workunit.client.0.trial155.stderr:safe to remove mon.e 2026-02-17T12:28:01.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2026-02-17T12:28:01.567 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:28:01.567 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:28:01.568 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:28:01.568 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:28:01.568 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:28:01.675 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:28:01.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2026-02-17T12:28:01.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:28:01.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:28:01.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:28:01.676 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:28:01.676 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:28:01.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:28:01.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:28:01.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:28:01.682 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:28:01.682 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:28:01.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:28:01.683 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:28:01.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:28:01.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:28:01.684 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:28:01.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:01.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:28:01.686 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:28:01.686 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:01.686 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:28:01.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:28:01.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:28:01.697 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:28:01.698 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:01.698 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:28:01.698 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:28:01.699 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:28:01.699 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:28:01.699 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T12:28:01.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/ok-to-stop 0 2026-02-17T12:28:01.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2026-02-17T12:28:01.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T12:28:01.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2026-02-17T12:28:01.700 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:28:01.700 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:28:01.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:28:01.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:28:01.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:28:01.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:28:01.701 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:28:01.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:28:01.702 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:28:01.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:28:01.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:28:01.703 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:28:01.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:01.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:28:01.705 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:28:01.705 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:01.705 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:28:01.706 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T12:28:01.706 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2026-02-17T12:28:01.707 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:28:01.708 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:01.708 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.62907 2026-02-17T12:28:01.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.62907 2026-02-17T12:28:01.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:28:01.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:28:01.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T12:28:01.710 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T12:28:01.710 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T12:28:01.773 INFO:tasks.workunit:Running workunit misc/rados-striper.sh... 2026-02-17T12:28:01.774 DEBUG:teuthology.orchestra.run.trial155:workunit test misc/rados-striper.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c96dfb3f50b3d02598a82af7104764bfdcd3919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh 2026-02-17T12:28:01.837 INFO:tasks.workunit.client.0.trial155.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T12:28:01.842 INFO:tasks.workunit.client.0.trial155.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T12:28:01.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:28:01.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:28:01.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T12:28:01.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T12:28:01.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T12:28:01.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T12:28:01.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T12:28:01.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/rados-striper 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:20: run: local dir=td/rados-striper 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:21: run: shift 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:23: run: export CEPH_MON=127.0.0.1:7116 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:23: run: CEPH_MON=127.0.0.1:7116 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:24: run: export CEPH_ARGS 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:25: run: uuidgen 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:25: run: CEPH_ARGS+='--fsid=e569f37a-05cd-400e-953f-f64bd667a69c --auth-supported=none ' 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:26: run: CEPH_ARGS+='--mon-host=127.0.0.1:7116 ' 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:29: run: setup td/rados-striper 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/rados-striper 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/rados-striper 2026-02-17T12:28:01.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/rados-striper 2026-02-17T12:28:01.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:28:01.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/rados-striper KILL 2026-02-17T12:28:01.844 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:28:01.844 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:28:01.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:28:01.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:28:01.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:28:01.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:28:01.845 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:28:01.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:28:01.845 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:28:01.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:28:01.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:28:01.846 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:28:01.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:01.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:28:01.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:28:01.847 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:01.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:28:01.848 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:28:01.848 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/rados-striper 2026-02-17T12:28:01.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:28:01.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:01.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.78430 2026-02-17T12:28:01.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.78430 2026-02-17T12:28:01.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:28:01.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:28:01.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/rados-striper 2026-02-17T12:28:01.851 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:28:01.851 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:01.852 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.78430 2026-02-17T12:28:01.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.78430 2026-02-17T12:28:01.852 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:28:01.854 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T12:28:01.854 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T12:28:01.854 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:28:01.854 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/rados-striper 1' TERM HUP INT 2026-02-17T12:28:01.854 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:32: run: run_mon td/rados-striper a 2026-02-17T12:28:01.854 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/rados-striper 2026-02-17T12:28:01.854 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:28:01.855 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:28:01.855 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:28:01.855 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/rados-striper/a 2026-02-17T12:28:01.855 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/rados-striper/a --run-dir=td/rados-striper 2026-02-17T12:28:01.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:28:01.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:01.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:01.873 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:01.873 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:01.873 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.78430 2026-02-17T12:28:01.874 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.78430/$cluster-$name.asok' 2026-02-17T12:28:01.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/rados-striper/a '--log-file=td/rados-striper/$name.log' '--admin-socket=/tmp/ceph-asok.78430/$cluster-$name.asok' --mon-cluster-log-file=td/rados-striper/log --run-dir=td/rados-striper '--pid-file=td/rados-striper/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:28:01.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:28:01.899 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:28:01.900 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:28:01.900 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:28:01.900 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:28:01.900 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:28:01.900 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:28:01.900 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:28:01.900 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:28:01.901 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:28:01.901 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:01.901 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.78430 2026-02-17T12:28:01.901 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.78430/ceph-mon.a.asok 2026-02-17T12:28:01.901 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:28:01.901 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.78430/ceph-mon.a.asok config get fsid 2026-02-17T12:28:01.947 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:28:01.947 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:28:01.947 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:28:01.947 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:28:01.947 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:28:01.947 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:28:01.948 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:28:01.948 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:28:01.948 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:28:01.949 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:01.949 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.78430 2026-02-17T12:28:01.949 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.78430/ceph-mon.a.asok 2026-02-17T12:28:01.949 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:28:01.949 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.78430/ceph-mon.a.asok config get mon_host 2026-02-17T12:28:01.994 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:33: run: run_osd td/rados-striper 0 2026-02-17T12:28:01.994 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/rados-striper 2026-02-17T12:28:01.994 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:28:01.994 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/rados-striper/0 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=e569f37a-05cd-400e-953f-f64bd667a69c --auth-supported=none --mon-host=127.0.0.1:7116 ' 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/rados-striper/0' 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/rados-striper/0/journal' 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/rados-striper' 2026-02-17T12:28:01.995 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.78430 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.78430/$cluster-$name.asok' 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.78430/$cluster-$name.asok' 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/rados-striper/$name.log' 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/rados-striper/$name.pid' 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:28:01.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:28:01.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:28:01.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:28:01.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:28:01.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:28:01.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/rados-striper/0 2026-02-17T12:28:01.997 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:28:01.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=585e4bc1-97fd-42eb-b836-19f98cf5a24a 2026-02-17T12:28:01.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 585e4bc1-97fd-42eb-b836-19f98cf5a24a' 2026-02-17T12:28:01.997 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 585e4bc1-97fd-42eb-b836-19f98cf5a24a 2026-02-17T12:28:01.998 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:28:02.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDSXpRpVto9ABAAILpl5f6a+mWD3RbC36L71g== 2026-02-17T12:28:02.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDSXpRpVto9ABAAILpl5f6a+mWD3RbC36L71g=="}' 2026-02-17T12:28:02.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 585e4bc1-97fd-42eb-b836-19f98cf5a24a -i td/rados-striper/0/new.json 2026-02-17T12:28:02.106 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:28:02.112 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/rados-striper/0/new.json 2026-02-17T12:28:02.113 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=e569f37a-05cd-400e-953f-f64bd667a69c --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/0 --osd-journal=td/rados-striper/0/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.78430/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDSXpRpVto9ABAAILpl5f6a+mWD3RbC36L71g== --osd-uuid 585e4bc1-97fd-42eb-b836-19f98cf5a24a 2026-02-17T12:28:02.130 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:02.128+0000 7fe89b811780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:02.132 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:02.129+0000 7fe89b811780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:02.133 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:02.130+0000 7fe89b811780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:02.133 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:02.131+0000 7fe89b811780 -1 bdev(0x5631140cbc00 td/rados-striper/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:28:02.133 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:02.131+0000 7fe89b811780 -1 bluestore(td/rados-striper/0) _read_fsid unparsable uuid 2026-02-17T12:28:04.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/rados-striper/0/keyring 2026-02-17T12:28:04.498 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:28:04.498 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:28:04.499 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:28:04.499 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/rados-striper/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:28:04.603 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:28:04.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:28:04.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=e569f37a-05cd-400e-953f-f64bd667a69c --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/0 --osd-journal=td/rados-striper/0/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.78430/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:28:04.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:28:04.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:28:04.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:28:04.620 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:04.618+0000 7f5469717780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:04.621 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:04.620+0000 7f5469717780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:04.622 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:04.621+0000 7f5469717780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:04.698 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:28:04.698 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:28:04.698 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:28:04.699 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:28:04.699 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:28:04.699 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:04.699 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:28:04.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:28:04.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:04.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:04.793 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:05.794 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:05.794 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:05.795 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:28:05.795 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:28:05.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:05.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:05.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:05.956 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:05.954+0000 7f5469717780 -1 Falling back to public interface 2026-02-17T12:28:06.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:06.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:06.889 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:28:06.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:28:06.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:06.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:06.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:07.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:07.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:07.985 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:28:07.986 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:28:07.986 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:07.986 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:08.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:08.905 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:08.903+0000 7f5469717780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:28:09.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:09.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:09.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:28:09.083 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:28:09.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:09.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:09.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:10.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:10.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:10.193 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:28:10.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:28:10.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:10.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:10.295 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1803103900,v1:127.0.0.1:6801/1803103900] [v2:127.0.0.1:6802/1803103900,v1:127.0.0.1:6803/1803103900] exists,up 585e4bc1-97fd-42eb-b836-19f98cf5a24a 2026-02-17T12:28:10.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:28:10.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:28:10.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:28:10.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:34: run: run_osd td/rados-striper 1 2026-02-17T12:28:10.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/rados-striper 2026-02-17T12:28:10.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:28:10.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:28:10.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:28:10.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/rados-striper/1 2026-02-17T12:28:10.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=e569f37a-05cd-400e-953f-f64bd667a69c --auth-supported=none --mon-host=127.0.0.1:7116 ' 2026-02-17T12:28:10.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:28:10.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:28:10.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:28:10.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/rados-striper/1' 2026-02-17T12:28:10.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/rados-striper/1/journal' 2026-02-17T12:28:10.302 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:28:10.302 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:28:10.302 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/rados-striper' 2026-02-17T12:28:10.302 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:28:10.302 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:10.302 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:10.302 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:10.302 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:10.302 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.78430 2026-02-17T12:28:10.302 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.78430/$cluster-$name.asok' 2026-02-17T12:28:10.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.78430/$cluster-$name.asok' 2026-02-17T12:28:10.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:28:10.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:28:10.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:28:10.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/rados-striper/$name.log' 2026-02-17T12:28:10.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/rados-striper/$name.pid' 2026-02-17T12:28:10.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:28:10.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:28:10.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:28:10.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:28:10.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:28:10.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:28:10.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/rados-striper/1 2026-02-17T12:28:10.304 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:28:10.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=dcfccba1-f289-433b-948e-b2c6db317f62 2026-02-17T12:28:10.304 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 dcfccba1-f289-433b-948e-b2c6db317f62 2026-02-17T12:28:10.305 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 dcfccba1-f289-433b-948e-b2c6db317f62' 2026-02-17T12:28:10.305 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:28:10.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDaXpRpdjhbEhAAYRKkAxaKbbzSyh34rKR6uA== 2026-02-17T12:28:10.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDaXpRpdjhbEhAAYRKkAxaKbbzSyh34rKR6uA=="}' 2026-02-17T12:28:10.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new dcfccba1-f289-433b-948e-b2c6db317f62 -i td/rados-striper/1/new.json 2026-02-17T12:28:10.412 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:28:10.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/rados-striper/1/new.json 2026-02-17T12:28:10.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=e569f37a-05cd-400e-953f-f64bd667a69c --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/1 --osd-journal=td/rados-striper/1/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.78430/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDaXpRpdjhbEhAAYRKkAxaKbbzSyh34rKR6uA== --osd-uuid dcfccba1-f289-433b-948e-b2c6db317f62 2026-02-17T12:28:10.436 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:10.434+0000 7fd568815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:10.437 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:10.435+0000 7fd568815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:10.438 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:10.436+0000 7fd568815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:10.439 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:10.437+0000 7fd568815780 -1 bdev(0x564231df1c00 td/rados-striper/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:28:10.439 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:10.437+0000 7fd568815780 -1 bluestore(td/rados-striper/1) _read_fsid unparsable uuid 2026-02-17T12:28:12.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/rados-striper/1/keyring 2026-02-17T12:28:12.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:28:12.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:28:12.552 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:28:12.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/rados-striper/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:28:12.654 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:28:12.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:28:12.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=e569f37a-05cd-400e-953f-f64bd667a69c --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/1 --osd-journal=td/rados-striper/1/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.78430/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:28:12.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:28:12.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:28:12.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:28:12.671 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:12.669+0000 7ff9ebcba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:12.672 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:12.671+0000 7ff9ebcba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:12.673 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:12.672+0000 7ff9ebcba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:12.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:28:12.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:28:12.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:28:12.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:28:12.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:28:12.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:12.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:28:12.749 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:28:12.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:12.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:28:12.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:13.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:13.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:13.845 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:28:13.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:28:13.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:13.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:28:13.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:14.246 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:14.245+0000 7ff9ebcba780 -1 Falling back to public interface 2026-02-17T12:28:14.942 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:14.942 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:14.942 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:28:14.943 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:28:14.943 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:14.943 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:28:15.039 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:16.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:16.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:16.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:28:16.041 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:28:16.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:16.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:28:16.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:16.962 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:16.961+0000 7ff9ebcba780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:28:17.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:17.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:17.135 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:28:17.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:28:17.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:17.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:28:17.233 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:18.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:18.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:18.235 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:28:18.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:28:18.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:18.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:28:18.330 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/3772521221,v1:127.0.0.1:6809/3772521221] [v2:127.0.0.1:6810/3772521221,v1:127.0.0.1:6811/3772521221] exists,up dcfccba1-f289-433b-948e-b2c6db317f62 2026-02-17T12:28:18.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:28:18.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:28:18.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:28:18.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:35: run: run_osd td/rados-striper 2 2026-02-17T12:28:18.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/rados-striper 2026-02-17T12:28:18.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:28:18.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:28:18.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:28:18.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/rados-striper/2 2026-02-17T12:28:18.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=e569f37a-05cd-400e-953f-f64bd667a69c --auth-supported=none --mon-host=127.0.0.1:7116 ' 2026-02-17T12:28:18.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:28:18.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:28:18.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:28:18.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/rados-striper/2' 2026-02-17T12:28:18.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/rados-striper/2/journal' 2026-02-17T12:28:18.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:28:18.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:28:18.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/rados-striper' 2026-02-17T12:28:18.336 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.78430 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.78430/$cluster-$name.asok' 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.78430/$cluster-$name.asok' 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/rados-striper/$name.log' 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/rados-striper/$name.pid' 2026-02-17T12:28:18.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:28:18.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:28:18.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:28:18.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:28:18.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:28:18.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:28:18.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/rados-striper/2 2026-02-17T12:28:18.338 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:28:18.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e7ebc6a5-d687-4809-b675-4bd4b3a7e5f0 2026-02-17T12:28:18.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 e7ebc6a5-d687-4809-b675-4bd4b3a7e5f0' 2026-02-17T12:28:18.339 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 e7ebc6a5-d687-4809-b675-4bd4b3a7e5f0 2026-02-17T12:28:18.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:28:18.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDiXpRpWvF9FBAAZ/TflFG38NfvbiLloK1qYw== 2026-02-17T12:28:18.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDiXpRpWvF9FBAAZ/TflFG38NfvbiLloK1qYw=="}' 2026-02-17T12:28:18.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e7ebc6a5-d687-4809-b675-4bd4b3a7e5f0 -i td/rados-striper/2/new.json 2026-02-17T12:28:18.444 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:28:18.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/rados-striper/2/new.json 2026-02-17T12:28:18.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=e569f37a-05cd-400e-953f-f64bd667a69c --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/2 --osd-journal=td/rados-striper/2/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.78430/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDiXpRpWvF9FBAAZ/TflFG38NfvbiLloK1qYw== --osd-uuid e7ebc6a5-d687-4809-b675-4bd4b3a7e5f0 2026-02-17T12:28:18.467 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:18.465+0000 7fa1ece0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:18.468 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:18.467+0000 7fa1ece0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:18.469 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:18.467+0000 7fa1ece0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:18.470 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:18.468+0000 7fa1ece0f780 -1 bdev(0x5583ba4f7c00 td/rados-striper/2/block) open stat got: (1) Operation not permitted 2026-02-17T12:28:18.470 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:18.468+0000 7fa1ece0f780 -1 bluestore(td/rados-striper/2) _read_fsid unparsable uuid 2026-02-17T12:28:20.836 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/rados-striper/2/keyring 2026-02-17T12:28:20.836 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:28:20.837 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:28:20.837 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:28:20.837 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/rados-striper/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:28:20.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:28:20.937 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:28:20.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=e569f37a-05cd-400e-953f-f64bd667a69c --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/2 --osd-journal=td/rados-striper/2/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.78430/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:28:20.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:28:20.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:28:20.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:28:20.952 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:20.950+0000 7fbf90c2e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:20.953 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:20.951+0000 7fbf90c2e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:20.954 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:20.952+0000 7fbf90c2e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:21.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:28:21.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:28:21.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:28:21.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:28:21.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:28:21.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:21.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:28:21.030 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:28:21.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:21.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:28:21.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:22.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:22.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:22.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:28:22.128 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:28:22.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:22.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:28:22.219 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:22.292 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:22.290+0000 7fbf90c2e780 -1 Falling back to public interface 2026-02-17T12:28:23.220 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:23.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:23.221 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:28:23.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:28:23.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:23.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:28:23.318 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:24.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:24.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:24.319 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:28:24.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:28:24.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:24.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:28:24.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:24.998 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:24.996+0000 7fbf90c2e780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:28:25.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:25.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:25.418 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:28:25.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:28:25.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:25.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:28:25.513 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:26.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:26.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:26.514 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:28:26.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:28:26.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:26.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:28:26.614 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/1727312705,v1:127.0.0.1:6817/1727312705] [v2:127.0.0.1:6818/1727312705,v1:127.0.0.1:6819/1727312705] exists,up e7ebc6a5-d687-4809-b675-4bd4b3a7e5f0 2026-02-17T12:28:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:28:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:28:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:28:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:36: run: create_rbd_pool 2026-02-17T12:28:26.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:28:26.706 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:28:26.712 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:28:26.712 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:28:26.862 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:28:26.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:28:27.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:28:28.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:39: run: dd if=/dev/urandom of=td/rados-striper/toyfile bs=1234 count=1 2026-02-17T12:28:28.151 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records in 2026-02-17T12:28:28.151 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records out 2026-02-17T12:28:28.152 INFO:tasks.workunit.client.0.trial155.stderr:1234 bytes (1.2 kB, 1.2 KiB) copied, 3.5456e-05 s, 34.8 MB/s 2026-02-17T12:28:28.152 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:42: run: rados --pool rbd --striper put toyfile td/rados-striper/toyfile 2026-02-17T12:28:28.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:45: run: rados --pool rbd --striper stat toyfile 2026-02-17T12:28:28.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:45: run: cut -d , -f 2 2026-02-17T12:28:28.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:46: run: rados --pool rbd stat toyfile.0000000000000000 2026-02-17T12:28:28.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:46: run: cut -d , -f 2 2026-02-17T12:28:28.205 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:47: run: echo ' size 1234' 2026-02-17T12:28:28.206 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:48: run: diff -w td/rados-striper/stripedStat td/rados-striper/refstat 2026-02-17T12:28:28.206 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:49: run: diff -w td/rados-striper/stat td/rados-striper/refstat 2026-02-17T12:28:28.207 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:50: run: rados --pool rbd stat toyfile 2026-02-17T12:28:28.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:51: run: grep -q 'No such file or directory' td/rados-striper/staterror 2026-02-17T12:28:28.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:54: run: rados --pool rbd --striper get toyfile td/rados-striper/stripedGroup 2026-02-17T12:28:28.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:55: run: diff -w td/rados-striper/toyfile td/rados-striper/stripedGroup 2026-02-17T12:28:28.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:56: run: rados --pool rbd get toyfile.0000000000000000 td/rados-striper/nonSTripedGroup 2026-02-17T12:28:28.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:57: run: diff -w td/rados-striper/toyfile td/rados-striper/nonSTripedGroup 2026-02-17T12:28:28.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:60: run: rados --pool rbd --striper truncate toyfile 12 2026-02-17T12:28:28.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:61: run: rados --pool rbd --striper stat toyfile 2026-02-17T12:28:28.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:61: run: cut -d , -f 2 2026-02-17T12:28:28.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:62: run: rados --pool rbd stat toyfile.0000000000000000 2026-02-17T12:28:28.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:62: run: cut -d , -f 2 2026-02-17T12:28:28.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:63: run: echo ' size 12' 2026-02-17T12:28:28.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:64: run: diff -w td/rados-striper/stripedStat td/rados-striper/reftrunc 2026-02-17T12:28:28.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:65: run: diff -w td/rados-striper/stat td/rados-striper/reftrunc 2026-02-17T12:28:28.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:69: run: rados --pool rbd --striper setxattr toyfile somexattr somevalue 2026-02-17T12:28:28.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:70: run: rados --pool rbd --striper getxattr toyfile somexattr 2026-02-17T12:28:28.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:71: run: rados --pool rbd getxattr toyfile.0000000000000000 somexattr 2026-02-17T12:28:28.363 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:72: run: echo somevalue 2026-02-17T12:28:28.363 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:73: run: diff -w td/rados-striper/xattrvalue td/rados-striper/refvalue 2026-02-17T12:28:28.364 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:74: run: diff -w td/rados-striper/xattrvalue2 td/rados-striper/refvalue 2026-02-17T12:28:28.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:75: run: rados --pool rbd --striper listxattr toyfile 2026-02-17T12:28:28.381 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:76: run: echo somexattr 2026-02-17T12:28:28.381 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:77: run: diff -w td/rados-striper/xattrlist td/rados-striper/reflist 2026-02-17T12:28:28.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:78: run: rados --pool rbd listxattr toyfile.0000000000000000 2026-02-17T12:28:28.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:78: run: grep -v striper 2026-02-17T12:28:28.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:79: run: diff -w td/rados-striper/xattrlist2 td/rados-striper/reflist 2026-02-17T12:28:28.399 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:80: run: rados --pool rbd --striper rmxattr toyfile somexattr 2026-02-17T12:28:28.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:82: run: local 'attr_not_found_str=No data available' 2026-02-17T12:28:28.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:83: run: uname 2026-02-17T12:28:28.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:83: run: '[' Linux = FreeBSD ']' 2026-02-17T12:28:28.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:85: run: expect_failure td/rados-striper 'No data available' rados --pool rbd --striper getxattr toyfile somexattr 2026-02-17T12:28:28.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: local dir=td/rados-striper 2026-02-17T12:28:28.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2026: expect_failure: shift 2026-02-17T12:28:28.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2027: expect_failure: local 'expected=No data available' 2026-02-17T12:28:28.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: shift 2026-02-17T12:28:28.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: local success 2026-02-17T12:28:28.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2031: expect_failure: rados --pool rbd --striper getxattr toyfile somexattr 2026-02-17T12:28:28.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: expect_failure: success=false 2026-02-17T12:28:28.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: false 2026-02-17T12:28:28.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: grep --quiet 'No data available' td/rados-striper/out 2026-02-17T12:28:28.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2041: expect_failure: return 0 2026-02-17T12:28:28.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:87: run: expect_failure td/rados-striper 'No data available' rados --pool rbd getxattr toyfile.0000000000000000 somexattr 2026-02-17T12:28:28.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: local dir=td/rados-striper 2026-02-17T12:28:28.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2026: expect_failure: shift 2026-02-17T12:28:28.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2027: expect_failure: local 'expected=No data available' 2026-02-17T12:28:28.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: shift 2026-02-17T12:28:28.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: local success 2026-02-17T12:28:28.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2031: expect_failure: rados --pool rbd getxattr toyfile.0000000000000000 somexattr 2026-02-17T12:28:28.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: expect_failure: success=false 2026-02-17T12:28:28.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: false 2026-02-17T12:28:28.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: grep --quiet 'No data available' td/rados-striper/out 2026-02-17T12:28:28.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2041: expect_failure: return 0 2026-02-17T12:28:28.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:91: run: rados --pool rbd --striper rm toyfile 2026-02-17T12:28:28.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:92: run: expect_failure td/rados-striper 'No such file or directory' rados --pool rbd --striper stat toyfile 2026-02-17T12:28:28.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: local dir=td/rados-striper 2026-02-17T12:28:28.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2026: expect_failure: shift 2026-02-17T12:28:28.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2027: expect_failure: local 'expected=No such file or directory' 2026-02-17T12:28:28.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: shift 2026-02-17T12:28:28.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: local success 2026-02-17T12:28:28.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2031: expect_failure: rados --pool rbd --striper stat toyfile 2026-02-17T12:28:28.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: expect_failure: success=false 2026-02-17T12:28:28.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: false 2026-02-17T12:28:28.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: grep --quiet 'No such file or directory' td/rados-striper/out 2026-02-17T12:28:28.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2041: expect_failure: return 0 2026-02-17T12:28:28.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:94: run: expect_failure td/rados-striper 'No such file or directory' rados --pool rbd stat toyfile.0000000000000000 2026-02-17T12:28:28.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: local dir=td/rados-striper 2026-02-17T12:28:28.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2026: expect_failure: shift 2026-02-17T12:28:28.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2027: expect_failure: local 'expected=No such file or directory' 2026-02-17T12:28:28.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: shift 2026-02-17T12:28:28.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: local success 2026-02-17T12:28:28.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2031: expect_failure: rados --pool rbd stat toyfile.0000000000000000 2026-02-17T12:28:28.500 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: expect_failure: success=false 2026-02-17T12:28:28.500 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: false 2026-02-17T12:28:28.500 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: grep --quiet 'No such file or directory' td/rados-striper/out 2026-02-17T12:28:28.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2041: expect_failure: return 0 2026-02-17T12:28:28.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:98: run: teardown td/rados-striper 2026-02-17T12:28:28.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/rados-striper 2026-02-17T12:28:28.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:28:28.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/rados-striper KILL 2026-02-17T12:28:28.502 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:28:28.502 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:28:28.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:28:28.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:28:28.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:28:28.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:28:28.608 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:28:28.609 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:28:28.609 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:28:28.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:28:28.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:28:28.611 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:28:28.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:28.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:28:28.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:28:28.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:28.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:28:28.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:28:28.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/rados-striper 2026-02-17T12:28:28.620 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:28:28.620 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:28.621 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.78430 2026-02-17T12:28:28.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.78430 2026-02-17T12:28:28.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:28:28.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:28:28.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T12:28:28.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/rados-striper 0 2026-02-17T12:28:28.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/rados-striper 2026-02-17T12:28:28.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T12:28:28.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/rados-striper KILL 2026-02-17T12:28:28.623 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:28:28.623 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:28:28.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:28:28.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:28:28.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:28:28.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:28:28.624 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:28:28.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:28:28.625 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:28:28.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:28:28.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:28:28.626 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:28:28.627 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:28.627 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:28:28.627 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:28:28.627 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:28.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:28:28.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T12:28:28.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/rados-striper 2026-02-17T12:28:28.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:28:28.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:28.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.78430 2026-02-17T12:28:28.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.78430 2026-02-17T12:28:28.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:28:28.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:28:28.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T12:28:28.632 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T12:28:28.632 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T12:28:28.696 INFO:tasks.workunit:Running workunit misc/test-ceph-helpers.sh... 2026-02-17T12:28:28.696 DEBUG:teuthology.orchestra.run.trial155:workunit test misc/test-ceph-helpers.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c96dfb3f50b3d02598a82af7104764bfdcd3919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-ceph-helpers.sh 2026-02-17T12:28:28.760 INFO:tasks.workunit.client.0.trial155.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T12:28:28.763 INFO:tasks.workunit.client.0.trial155.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T12:28:28.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2391: run_tests: export PATH=./bin:.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:28:28.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2391: run_tests: PATH=./bin:.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:28:28.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: run_tests: export CEPH_MON=127.0.0.1:7109 2026-02-17T12:28:28.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: run_tests: CEPH_MON=127.0.0.1:7109 2026-02-17T12:28:28.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: run_tests: export CEPH_ARGS 2026-02-17T12:28:28.764 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: run_tests: uuidgen 2026-02-17T12:28:28.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: run_tests: CEPH_ARGS+=' --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none ' 2026-02-17T12:28:28.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: run_tests: CEPH_ARGS+='--mon-host=127.0.0.1:7109 ' 2026-02-17T12:28:28.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: run_tests: export CEPH_CONF=/dev/null 2026-02-17T12:28:28.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: run_tests: CEPH_CONF=/dev/null 2026-02-17T12:28:28.766 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: run_tests: set 2026-02-17T12:28:28.766 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: run_tests: sed -n -e 's/^\(test_[0-9a-z_]*\) .*/\1/p' 2026-02-17T12:28:28.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: run_tests: local 'funcs=test_activate_osd 2026-02-17T12:28:28.768 INFO:tasks.workunit.client.0.trial155.stderr:test_activate_osd_after_mark_down 2026-02-17T12:28:28.768 INFO:tasks.workunit.client.0.trial155.stderr:test_activate_osd_skip_benchmark 2026-02-17T12:28:28.768 INFO:tasks.workunit.client.0.trial155.stderr:test_destroy_osd 2026-02-17T12:28:28.768 INFO:tasks.workunit.client.0.trial155.stderr:test_display_logs 2026-02-17T12:28:28.768 INFO:tasks.workunit.client.0.trial155.stderr:test_erasure_code_plugin_exists 2026-02-17T12:28:28.768 INFO:tasks.workunit.client.0.trial155.stderr:test_expect_failure 2026-02-17T12:28:28.768 INFO:tasks.workunit.client.0.trial155.stderr:test_flush_pg_stats 2026-02-17T12:28:28.768 INFO:tasks.workunit.client.0.trial155.stderr:test_get_config 2026-02-17T12:28:28.768 INFO:tasks.workunit.client.0.trial155.stderr:test_get_is_making_recovery_progress 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_get_last_scrub_stamp 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_get_not_primary 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_get_num_active_clean 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_get_num_active_or_peered 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_get_num_pgs 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_get_op_scheduler 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_get_osd_id_used_by_pgs 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_get_osds 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_get_pg 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_get_primary 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_get_timeout_delays 2026-02-17T12:28:28.769 INFO:tasks.workunit.client.0.trial155.stderr:test_is_clean 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_kill_daemon 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_kill_daemons 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_objectstore_tool 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_pg_schedule_scrub 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_pg_scrub 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_repair 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_run_in_background 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_run_mon 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_run_osd 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_set_config 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_setup 2026-02-17T12:28:28.770 INFO:tasks.workunit.client.0.trial155.stderr:test_teardown 2026-02-17T12:28:28.771 INFO:tasks.workunit.client.0.trial155.stderr:test_wait_background 2026-02-17T12:28:28.771 INFO:tasks.workunit.client.0.trial155.stderr:test_wait_for_clean 2026-02-17T12:28:28.771 INFO:tasks.workunit.client.0.trial155.stderr:test_wait_for_health_ok 2026-02-17T12:28:28.771 INFO:tasks.workunit.client.0.trial155.stderr:test_wait_for_osd 2026-02-17T12:28:28.771 INFO:tasks.workunit.client.0.trial155.stderr:test_wait_for_peered 2026-02-17T12:28:28.771 INFO:tasks.workunit.client.0.trial155.stderr:test_wait_for_scrub 2026-02-17T12:28:28.771 INFO:tasks.workunit.client.0.trial155.stderr:test_wait_osd_id_used_by_pgs' 2026-02-17T12:28:28.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: run_tests: local dir=td/ceph-helpers 2026-02-17T12:28:28.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:28:28.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_activate_osd td/ceph-helpers 2026-02-17T12:28:28.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:886: test_activate_osd: local dir=td/ceph-helpers 2026-02-17T12:28:28.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:888: test_activate_osd: setup td/ceph-helpers 2026-02-17T12:28:28.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:28:28.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:28:28.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:28:28.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:28:28.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:28:28.772 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:28:28.772 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:28:28.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:28:28.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:28:28.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:28:28.775 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:28:28.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:28:28.775 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:28:28.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:28:28.775 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:28:28.775 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:28:28.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:28:28.775 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:28.775 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:28:28.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:28:28.778 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:28:28.778 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:890: test_activate_osd: run_mon td/ceph-helpers a 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:28:28.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:28:28.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:28:28.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-17T12:28:28.799 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:28:28.799 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:28.799 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:28.799 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:28.799 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:28.800 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:28.800 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:28.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:28:28.825 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:28:28.826 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:28:28.827 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:28:28.827 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:28:28.827 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:28:28.827 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:28:28.827 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:28:28.827 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:28:28.827 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:28:28.827 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:28:28.827 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:28.827 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:28.828 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:28:28.828 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:28:28.828 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:28:28.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:28:28.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:28:28.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:28:28.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:28:28.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:28:28.872 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:28:28.872 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:28:28.872 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:28:28.872 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:28:28.873 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:28.873 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:28.873 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:28:28.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:28:28.873 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:28:28.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:891: test_activate_osd: run_mgr td/ceph-helpers x 2026-02-17T12:28:28.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:28:28.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:28:28.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:28:28.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:28:28.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:28:28.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:28:29.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:28:29.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:29.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:29.020 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:29.020 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:29.020 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:29.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:29.021 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:28:29.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:28:29.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:893: test_activate_osd: run_osd td/ceph-helpers 0 2026-02-17T12:28:29.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:28:29.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:28:29.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:28:29.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:28:29.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:28:29.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:28:29.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:28:29.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:28:29.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:28:29.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:28:29.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:28:29.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:28:29.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:28:29.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:28:29.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:28:29.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:29.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:29.043 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:29.043 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:29.043 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:29.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:29.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:29.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:28:29.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:28:29.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=67e788cc-ab86-4e03-b6a9-7d355c64cac2 2026-02-17T12:28:29.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 67e788cc-ab86-4e03-b6a9-7d355c64cac2' 2026-02-17T12:28:29.045 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 67e788cc-ab86-4e03-b6a9-7d355c64cac2 2026-02-17T12:28:29.045 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:28:29.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDtXpRpV1kFAxAA01HCiOOYPFCGr5TJqd8bNA== 2026-02-17T12:28:29.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDtXpRpV1kFAxAA01HCiOOYPFCGr5TJqd8bNA=="}' 2026-02-17T12:28:29.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 67e788cc-ab86-4e03-b6a9-7d355c64cac2 -i td/ceph-helpers/0/new.json 2026-02-17T12:28:29.155 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:28:29.162 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:28:29.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDtXpRpV1kFAxAA01HCiOOYPFCGr5TJqd8bNA== --osd-uuid 67e788cc-ab86-4e03-b6a9-7d355c64cac2 2026-02-17T12:28:29.181 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:29.179+0000 7fabd70e7780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:29.182 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:29.181+0000 7fabd70e7780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:29.183 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:29.182+0000 7fabd70e7780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:29.184 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:29.182+0000 7fabd70e7780 -1 bdev(0x5571fdf79c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:28:29.184 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:29.182+0000 7fabd70e7780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:28:31.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:28:31.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:28:31.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:28:31.590 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:28:31.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:28:31.845 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:28:31.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:28:31.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:28:31.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:28:31.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:28:31.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:28:31.862 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:31.860+0000 7f83c6984780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:31.863 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:31.861+0000 7f83c6984780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:31.864 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:31.862+0000 7f83c6984780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:32.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:28:32.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:28:32.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:28:32.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:28:32.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:28:32.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:32.036 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:28:32.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:28:32.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:32.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:32.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:33.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:33.226 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:33.226 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:28:33.226 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:28:33.227 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:33.227 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:33.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:33.444 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:33.443+0000 7f83c6984780 -1 Falling back to public interface 2026-02-17T12:28:34.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:34.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:34.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:28:34.416 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:28:34.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:34.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:34.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:35.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:35.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:35.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:28:35.606 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:28:35.607 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:35.607 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:35.795 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:36.385 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:36.384+0000 7f83c6984780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:28:36.795 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:36.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:36.796 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:28:36.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:28:36.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:36.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:36.987 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4038588092,v1:127.0.0.1:6803/4038588092] [v2:127.0.0.1:6804/4038588092,v1:127.0.0.1:6805/4038588092] exists,up 67e788cc-ab86-4e03-b6a9-7d355c64cac2 2026-02-17T12:28:36.989 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:28:36.989 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:28:36.989 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:28:36.989 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:895: test_activate_osd: get_asok_path osd.0 2026-02-17T12:28:36.989 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:28:36.989 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:28:36.989 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:28:36.989 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:36.990 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:36.990 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.0.asok 2026-02-17T12:28:36.990 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:895: test_activate_osd: CEPH_ARGS= 2026-02-17T12:28:36.990 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:895: test_activate_osd: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-osd.0.asok config get osd_max_backfills 2026-02-17T12:28:37.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:895: test_activate_osd: local 'backfills={"osd_max_backfills":"1"}' 2026-02-17T12:28:37.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:896: test_activate_osd: echo '{"osd_max_backfills":"1"}' 2026-02-17T12:28:37.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:896: test_activate_osd: grep --quiet osd_max_backfills 2026-02-17T12:28:37.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:898: test_activate_osd: kill_daemons td/ceph-helpers TERM osd 2026-02-17T12:28:37.038 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:28:37.038 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:28:37.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:28:37.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:28:37.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:28:38.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:28:38.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:900: test_activate_osd: activate_osd td/ceph-helpers 0 --osd-max-backfills 20 2026-02-17T12:28:38.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ceph-helpers 2026-02-17T12:28:38.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:28:38.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T12:28:38.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:28:38.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:28:38.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:28:38.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:28:38.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:28:38.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:28:38.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:28:38.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:28:38.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:28:38.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:28:38.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:28:38.347 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:28:38.347 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:38.347 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+='--osd-max-backfills 20' 2026-02-17T12:28:38.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:28:38.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T12:28:38.349 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:28:38.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-max-backfills 20 2026-02-17T12:28:38.349 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ceph-helpers/0/whoami 2026-02-17T12:28:38.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T12:28:38.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:28:38.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:28:38.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:28:38.366 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:38.365+0000 7ff114953780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:38.367 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:38.366+0000 7ff114953780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:38.368 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:38.367+0000 7ff114953780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:38.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T12:28:38.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:28:38.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:28:38.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:28:38.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:28:38.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:38.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:28:38.541 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:28:38.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:38.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:38.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:39.707 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:39.705+0000 7ff114953780 -1 Falling back to public interface 2026-02-17T12:28:39.729 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:39.729 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:39.729 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:28:39.730 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:28:39.730 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:39.730 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:39.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:40.918 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:40.919 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:40.919 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:28:40.919 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:28:40.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:40.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:41.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:42.110 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:42.110 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:42.111 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:28:42.111 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:28:42.111 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:42.111 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:42.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:42.425 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:42.424+0000 7ff114953780 -1 osd.0 5 log_to_monitors true 2026-02-17T12:28:43.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:43.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:43.299 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:28:43.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:28:43.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:43.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:43.497 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 8 up_thru 0 down_at 6 last_clean_interval [0,0) [v2:127.0.0.1:6802/2781630822,v1:127.0.0.1:6803/2781630822] [v2:127.0.0.1:6804/2781630822,v1:127.0.0.1:6805/2781630822] exists,up 67e788cc-ab86-4e03-b6a9-7d355c64cac2 2026-02-17T12:28:43.499 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:28:43.499 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:28:43.499 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:28:43.499 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:902: test_activate_osd: get_asok_path osd.0 2026-02-17T12:28:43.499 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:28:43.499 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:28:43.499 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:28:43.499 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:43.499 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:43.500 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.0.asok 2026-02-17T12:28:43.500 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:902: test_activate_osd: CEPH_ARGS= 2026-02-17T12:28:43.500 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:902: test_activate_osd: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-osd.0.asok config get osd_max_backfills 2026-02-17T12:28:43.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:902: test_activate_osd: local 'backfills={"osd_max_backfills":"20"}' 2026-02-17T12:28:43.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:903: test_activate_osd: test '{"osd_max_backfills":"20"}' = '{"osd_max_backfills":"20"}' 2026-02-17T12:28:43.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:905: test_activate_osd: teardown td/ceph-helpers 2026-02-17T12:28:43.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:28:43.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:28:43.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:28:43.548 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:28:43.549 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:28:43.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:28:43.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:28:43.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:28:43.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:28:43.654 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:28:43.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:28:43.655 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:28:43.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:28:43.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:28:43.657 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:28:43.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:43.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:28:43.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:28:43.659 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:43.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:28:43.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:28:43.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:28:43.664 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:28:43.664 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:43.664 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:43.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:28:43.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:28:43.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:28:43.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:28:43.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_activate_osd_after_mark_down td/ceph-helpers 2026-02-17T12:28:43.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:909: test_activate_osd_after_mark_down: local dir=td/ceph-helpers 2026-02-17T12:28:43.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:911: test_activate_osd_after_mark_down: setup td/ceph-helpers 2026-02-17T12:28:43.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:28:43.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:28:43.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:28:43.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:28:43.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:28:43.666 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:28:43.666 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:28:43.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:28:43.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:28:43.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:28:43.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:28:43.667 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:28:43.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:28:43.668 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:28:43.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:28:43.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:28:43.669 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:28:43.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:43.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:28:43.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:28:43.670 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:28:43.671 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:28:43.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:28:43.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:28:43.673 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:28:43.673 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:43.673 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:43.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:28:43.674 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:28:43.674 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:28:43.674 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:28:43.675 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:28:43.675 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:43.675 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:43.675 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:28:43.676 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:28:43.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:28:43.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:28:43.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:28:43.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:913: test_activate_osd_after_mark_down: run_mon td/ceph-helpers a 2026-02-17T12:28:43.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:28:43.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:28:43.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:28:43.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:28:43.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:28:43.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-17T12:28:43.696 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:28:43.696 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:43.696 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:43.697 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:43.697 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:43.697 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:43.697 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:43.697 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:28:43.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:28:43.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:28:43.725 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:28:43.725 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:28:43.725 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:28:43.725 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:28:43.725 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:28:43.725 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:28:43.725 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:28:43.725 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:28:43.725 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:43.726 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:43.726 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:28:43.726 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:28:43.726 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:28:43.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:28:43.771 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:28:43.771 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:28:43.771 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:28:43.771 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:28:43.771 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:28:43.771 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:28:43.771 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:28:43.772 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:28:43.772 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:43.772 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:43.772 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:28:43.772 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:28:43.772 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:28:43.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: test_activate_osd_after_mark_down: run_mgr td/ceph-helpers x 2026-02-17T12:28:43.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:28:43.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:28:43.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:28:43.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:28:43.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:28:43.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:28:43.916 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:28:43.916 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:43.916 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:43.916 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:43.917 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:43.917 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:43.917 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:43.917 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:28:43.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:28:43.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: test_activate_osd_after_mark_down: run_osd td/ceph-helpers 0 2026-02-17T12:28:43.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:28:43.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:28:43.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:28:43.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:28:43.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:28:43.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:28:43.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:28:43.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:28:43.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:28:43.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:28:43.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b9638c86-acd0-455f-b7b9-327ef51280be 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 b9638c86-acd0-455f-b7b9-327ef51280be' 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 b9638c86-acd0-455f-b7b9-327ef51280be 2026-02-17T12:28:43.937 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:28:43.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD7XpRpt4Z6OBAATvsJ6YnU7qk6taxlqdg5Qw== 2026-02-17T12:28:43.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD7XpRpt4Z6OBAATvsJ6YnU7qk6taxlqdg5Qw=="}' 2026-02-17T12:28:43.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b9638c86-acd0-455f-b7b9-327ef51280be -i td/ceph-helpers/0/new.json 2026-02-17T12:28:44.051 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:28:44.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:28:44.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD7XpRpt4Z6OBAATvsJ6YnU7qk6taxlqdg5Qw== --osd-uuid b9638c86-acd0-455f-b7b9-327ef51280be 2026-02-17T12:28:44.076 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:44.075+0000 7fdad1013780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:44.077 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:44.076+0000 7fdad1013780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:44.078 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:44.077+0000 7fdad1013780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:44.079 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:44.077+0000 7fdad1013780 -1 bdev(0x556c25809c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:28:44.079 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:44.077+0000 7fdad1013780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:28:46.723 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:28:46.723 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:28:46.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:28:46.724 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:28:46.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:28:46.977 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:28:46.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:28:46.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:28:46.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:28:46.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:28:46.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:28:46.995 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:46.993+0000 7f19f4a0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:46.996 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:46.995+0000 7f19f4a0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:46.997 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:46.996+0000 7f19f4a0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:47.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:28:47.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:28:47.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:28:47.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:28:47.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:28:47.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:47.169 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:28:47.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:28:47.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:47.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:47.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:48.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:48.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:48.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:28:48.359 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:28:48.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:48.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:48.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:48.589 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:48.587+0000 7f19f4a0d780 -1 Falling back to public interface 2026-02-17T12:28:49.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:49.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:49.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:28:49.554 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:28:49.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:49.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:49.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:50.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:50.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:50.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:28:50.745 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:28:50.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:50.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:50.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:51.520 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:51.518+0000 7f19f4a0d780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:28:51.933 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:51.934 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:51.934 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:28:51.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:28:51.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:51.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:52.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:53.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:53.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:53.130 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:28:53.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:28:53.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:53.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:53.319 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/145218610,v1:127.0.0.1:6803/145218610] [v2:127.0.0.1:6804/145218610,v1:127.0.0.1:6805/145218610] exists,up b9638c86-acd0-455f-b7b9-327ef51280be 2026-02-17T12:28:53.321 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:28:53.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:28:53.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:28:53.322 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: test_activate_osd_after_mark_down: get_asok_path osd.0 2026-02-17T12:28:53.322 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:28:53.322 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:28:53.323 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:28:53.323 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:53.323 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:53.323 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.0.asok 2026-02-17T12:28:53.323 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: test_activate_osd_after_mark_down: CEPH_ARGS= 2026-02-17T12:28:53.323 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: test_activate_osd_after_mark_down: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-osd.0.asok config get osd_max_backfills 2026-02-17T12:28:53.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: test_activate_osd_after_mark_down: local 'backfills={"osd_max_backfills":"1"}' 2026-02-17T12:28:53.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: test_activate_osd_after_mark_down: echo '{"osd_max_backfills":"1"}' 2026-02-17T12:28:53.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: test_activate_osd_after_mark_down: grep --quiet osd_max_backfills 2026-02-17T12:28:53.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: test_activate_osd_after_mark_down: kill_daemons td/ceph-helpers TERM osd 2026-02-17T12:28:53.369 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:28:53.369 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:28:53.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:28:53.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:28:53.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:28:54.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:28:54.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: test_activate_osd_after_mark_down: ceph osd down 0 2026-02-17T12:28:54.867 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 is already down. 2026-02-17T12:28:54.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: test_activate_osd_after_mark_down: wait_for_osd down 0 2026-02-17T12:28:54.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=down 2026-02-17T12:28:54.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:28:54.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:28:54.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:28:54.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:54.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:28:54.874 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:28:54.875 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:54.875 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 down' 2026-02-17T12:28:55.061 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 down in weight 1 up_from 5 up_thru 0 down_at 7 last_clean_interval [0,0) [v2:127.0.0.1:6802/145218610,v1:127.0.0.1:6803/145218610] [v2:127.0.0.1:6804/145218610,v1:127.0.0.1:6805/145218610] exists b9638c86-acd0-455f-b7b9-327ef51280be 2026-02-17T12:28:55.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:28:55.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:28:55.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:28:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: test_activate_osd_after_mark_down: activate_osd td/ceph-helpers 0 --osd-max-backfills 20 2026-02-17T12:28:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ceph-helpers 2026-02-17T12:28:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:28:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T12:28:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:28:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:28:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:28:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:28:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:28:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:28:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:28:55.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:28:55.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:28:55.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:28:55.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:28:55.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:28:55.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:28:55.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:28:55.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:28:55.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+='--osd-max-backfills 20' 2026-02-17T12:28:55.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:28:55.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T12:28:55.068 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:28:55.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-max-backfills 20 2026-02-17T12:28:55.069 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ceph-helpers/0/whoami 2026-02-17T12:28:55.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T12:28:55.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:28:55.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:28:55.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:28:55.080 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:55.079+0000 7f2bae1b4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:55.081 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:55.080+0000 7f2bae1b4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:55.082 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:55.081+0000 7f2bae1b4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:28:55.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T12:28:55.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:28:55.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:28:55.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:28:55.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:28:55.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:55.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:28:55.255 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:28:55.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:55.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:55.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:56.167 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:56.166+0000 7f2bae1b4780 -1 Falling back to public interface 2026-02-17T12:28:56.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:56.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:56.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:28:56.443 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:28:56.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:56.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:56.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:57.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:57.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:57.630 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:28:57.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:28:57.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:57.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:57.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:28:58.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:28:58.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:28:58.821 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:28:58.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:28:58.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:28:58.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:28:58.891 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:28:58.890+0000 7f2bae1b4780 -1 osd.0 6 log_to_monitors true 2026-02-17T12:28:59.016 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:00.017 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:00.017 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:00.018 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:29:00.018 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:29:00.018 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:00.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:00.206 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 9 up_thru 0 down_at 7 last_clean_interval [5,6) [v2:127.0.0.1:6802/1094253723,v1:127.0.0.1:6803/1094253723] [v2:127.0.0.1:6804/1094253723,v1:127.0.0.1:6805/1094253723] exists,up b9638c86-acd0-455f-b7b9-327ef51280be 2026-02-17T12:29:00.207 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:29:00.207 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:29:00.207 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:29:00.207 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: test_activate_osd_after_mark_down: get_asok_path osd.0 2026-02-17T12:29:00.208 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:29:00.208 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:29:00.208 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:00.208 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:00.208 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:00.208 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.0.asok 2026-02-17T12:29:00.208 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: test_activate_osd_after_mark_down: CEPH_ARGS= 2026-02-17T12:29:00.208 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: test_activate_osd_after_mark_down: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-osd.0.asok config get osd_max_backfills 2026-02-17T12:29:00.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: test_activate_osd_after_mark_down: local 'backfills={"osd_max_backfills":"20"}' 2026-02-17T12:29:00.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:928: test_activate_osd_after_mark_down: test '{"osd_max_backfills":"20"}' = '{"osd_max_backfills":"20"}' 2026-02-17T12:29:00.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:930: test_activate_osd_after_mark_down: teardown td/ceph-helpers 2026-02-17T12:29:00.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:00.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:00.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:00.257 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:00.257 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:00.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:00.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:00.258 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:00.363 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:00.363 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:00.364 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:00.364 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:00.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:00.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:00.366 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:00.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:00.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:00.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:00.367 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:00.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:00.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:00.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:00.372 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:00.373 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:00.373 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:00.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:00.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:00.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:00.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:29:00.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_activate_osd_skip_benchmark td/ceph-helpers 2026-02-17T12:29:00.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:934: test_activate_osd_skip_benchmark: local dir=td/ceph-helpers 2026-02-17T12:29:00.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:936: test_activate_osd_skip_benchmark: setup td/ceph-helpers 2026-02-17T12:29:00.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:29:00.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:29:00.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:00.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:00.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:00.376 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:00.376 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:00.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:00.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:00.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:00.377 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:00.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:00.377 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:00.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:00.378 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:00.378 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:00.378 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:00.379 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:00.379 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:00.379 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:00.380 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:00.380 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:00.381 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:00.381 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:00.382 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:00.382 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:00.382 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:00.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:00.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:00.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:00.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:29:00.384 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:29:00.384 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:00.385 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:00.385 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:29:00.385 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:29:00.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:29:00.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:29:00.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:29:00.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:938: test_activate_osd_skip_benchmark: run_mon td/ceph-helpers a 2026-02-17T12:29:00.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:29:00.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:29:00.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:29:00.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:29:00.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:29:00.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-17T12:29:00.406 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:29:00.407 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:00.407 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:00.407 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:00.407 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:00.407 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:00.407 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:00.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:29:00.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:29:00.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:29:00.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:00.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:00.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:29:00.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:29:00.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:00.435 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:00.435 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:00.435 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:00.435 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:00.435 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:00.435 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:00.435 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:00.435 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:29:00.479 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:29:00.479 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:00.479 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:00.479 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:29:00.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:29:00.480 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:00.480 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:00.480 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:00.480 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:00.480 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:00.480 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:00.480 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:00.481 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:00.481 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:29:00.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:939: test_activate_osd_skip_benchmark: run_mgr td/ceph-helpers x 2026-02-17T12:29:00.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:29:00.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:29:00.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:29:00.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:29:00.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:29:00.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:29:00.626 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:29:00.626 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:00.626 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:00.626 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:00.626 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:00.626 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:00.626 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:00.627 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:00.627 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:00.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:942: test_activate_osd_skip_benchmark: run_osd td/ceph-helpers 0 --osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true 2026-02-17T12:29:00.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:29:00.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:29:00.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:29:00.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:29:00.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:29:00.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:29:00.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:00.648 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:29:00.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+='--osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true' 2026-02-17T12:29:00.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:29:00.650 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:29:00.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ee905e89-4783-4374-bff2-25b11069cb72 2026-02-17T12:29:00.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 ee905e89-4783-4374-bff2-25b11069cb72' 2026-02-17T12:29:00.650 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 ee905e89-4783-4374-bff2-25b11069cb72 2026-02-17T12:29:00.650 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:29:00.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAMX5RpLowsJxAAFA6FaaxjLF7tZ0faSrZNeA== 2026-02-17T12:29:00.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAMX5RpLowsJxAAFA6FaaxjLF7tZ0faSrZNeA=="}' 2026-02-17T12:29:00.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ee905e89-4783-4374-bff2-25b11069cb72 -i td/ceph-helpers/0/new.json 2026-02-17T12:29:00.763 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:00.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:29:00.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true --mkfs --key AQAMX5RpLowsJxAAFA6FaaxjLF7tZ0faSrZNeA== --osd-uuid ee905e89-4783-4374-bff2-25b11069cb72 2026-02-17T12:29:00.789 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:00.788+0000 7fbc8361a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:00.790 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:00.789+0000 7fbc8361a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:00.791 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:00.790+0000 7fbc8361a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:00.792 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:00.790+0000 7fbc8361a780 -1 bdev(0x55e1882c3c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:29:00.792 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:00.790+0000 7fbc8361a780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:29:03.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:29:03.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:29:03.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:29:03.191 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:29:03.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:29:03.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:29:03.450 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:29:03.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true 2026-02-17T12:29:03.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:29:03.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:29:03.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:29:03.467 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:03.466+0000 7fb07800f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:03.468 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:03.467+0000 7fb07800f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:03.469 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:03.468+0000 7fb07800f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:03.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:29:03.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:29:03.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:29:03.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:29:03.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:29:03.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:03.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:29:03.639 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:03.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:03.640 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:03.828 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:04.829 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:04.830 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:04.830 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:29:04.830 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:29:04.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:04.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:05.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:05.054 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:05.052+0000 7fb07800f780 -1 Falling back to public interface 2026-02-17T12:29:06.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:06.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:06.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:29:06.025 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:29:06.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:06.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:06.215 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:07.216 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:07.216 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:07.216 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:29:07.216 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:29:07.217 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:07.217 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:07.405 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:08.279 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:08.277+0000 7fb07800f780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:29:08.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:08.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:08.407 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:29:08.408 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:29:08.408 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:08.408 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:08.600 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/684181720,v1:127.0.0.1:6803/684181720] [v2:127.0.0.1:6804/684181720,v1:127.0.0.1:6805/684181720] exists,up ee905e89-4783-4374-bff2-25b11069cb72 2026-02-17T12:29:08.602 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:29:08.602 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:29:08.602 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:29:08.602 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:945: test_activate_osd_skip_benchmark: get_asok_path osd.0 2026-02-17T12:29:08.602 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:29:08.602 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:29:08.602 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:08.603 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:08.603 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:08.603 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.0.asok 2026-02-17T12:29:08.603 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:945: test_activate_osd_skip_benchmark: CEPH_ARGS= 2026-02-17T12:29:08.603 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:945: test_activate_osd_skip_benchmark: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-osd.0.asok config get osd_mclock_max_capacity_iops_hdd 2026-02-17T12:29:08.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:945: test_activate_osd_skip_benchmark: local 'max_iops_hdd_def={"osd_mclock_max_capacity_iops_hdd":"315.000000"}' 2026-02-17T12:29:08.652 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:947: test_activate_osd_skip_benchmark: get_asok_path osd.0 2026-02-17T12:29:08.653 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:29:08.653 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:29:08.653 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:08.653 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:08.653 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:08.653 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.0.asok 2026-02-17T12:29:08.653 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:947: test_activate_osd_skip_benchmark: CEPH_ARGS= 2026-02-17T12:29:08.653 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:947: test_activate_osd_skip_benchmark: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-osd.0.asok config get osd_mclock_max_capacity_iops_ssd 2026-02-17T12:29:08.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:947: test_activate_osd_skip_benchmark: local 'max_iops_ssd_def={"osd_mclock_max_capacity_iops_ssd":"21500.000000"}' 2026-02-17T12:29:08.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:949: test_activate_osd_skip_benchmark: kill_daemons td/ceph-helpers TERM osd 2026-02-17T12:29:08.701 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:08.701 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:08.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:08.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:08.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:10.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:10.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:950: test_activate_osd_skip_benchmark: ceph osd down 0 2026-02-17T12:29:10.200 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 is already down. 2026-02-17T12:29:10.207 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:951: test_activate_osd_skip_benchmark: wait_for_osd down 0 2026-02-17T12:29:10.208 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=down 2026-02-17T12:29:10.208 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:29:10.208 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:29:10.208 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:29:10.208 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:10.208 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:10.209 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:29:10.209 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:10.209 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 down' 2026-02-17T12:29:10.399 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 down in weight 1 up_from 5 up_thru 0 down_at 6 last_clean_interval [0,0) [v2:127.0.0.1:6802/684181720,v1:127.0.0.1:6803/684181720] [v2:127.0.0.1:6804/684181720,v1:127.0.0.1:6805/684181720] exists ee905e89-4783-4374-bff2-25b11069cb72 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:955: test_activate_osd_skip_benchmark: activate_osd td/ceph-helpers 0 --osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ceph-helpers 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:29:10.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+='--osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true' 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T12:29:10.401 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:29:10.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-op-queue=mclock_scheduler --osd-mclock-skip-benchmark=true 2026-02-17T12:29:10.402 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ceph-helpers/0/whoami 2026-02-17T12:29:10.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T12:29:10.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:29:10.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:29:10.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:29:10.419 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:10.417+0000 7f2042014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:10.420 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:10.419+0000 7f2042014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:10.421 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:10.419+0000 7f2042014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:10.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T12:29:10.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:29:10.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:29:10.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:29:10.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:29:10.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:10.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:29:10.591 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:10.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:10.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:10.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:11.507 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:11.505+0000 7f2042014780 -1 Falling back to public interface 2026-02-17T12:29:11.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:11.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:11.779 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:29:11.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:29:11.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:11.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:11.968 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:12.969 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:12.970 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:12.970 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:29:12.971 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:29:12.971 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:12.971 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:13.159 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:14.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:14.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:14.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:29:14.160 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:29:14.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:14.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:14.200 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:14.199+0000 7f2042014780 -1 osd.0 5 log_to_monitors true 2026-02-17T12:29:14.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:15.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:15.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:15.352 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:29:15.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:29:15.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:15.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:15.547 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 8 up_thru 0 down_at 6 last_clean_interval [0,0) [v2:127.0.0.1:6802/3694025238,v1:127.0.0.1:6803/3694025238] [v2:127.0.0.1:6804/3694025238,v1:127.0.0.1:6805/3694025238] exists,up ee905e89-4783-4374-bff2-25b11069cb72 2026-02-17T12:29:15.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:29:15.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:29:15.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:29:15.548 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:958: test_activate_osd_skip_benchmark: get_asok_path osd.0 2026-02-17T12:29:15.548 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:29:15.548 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:29:15.548 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:15.549 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:15.549 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:15.549 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.0.asok 2026-02-17T12:29:15.549 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:958: test_activate_osd_skip_benchmark: CEPH_ARGS= 2026-02-17T12:29:15.549 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:958: test_activate_osd_skip_benchmark: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-osd.0.asok config get osd_mclock_max_capacity_iops_hdd 2026-02-17T12:29:15.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:958: test_activate_osd_skip_benchmark: local 'max_iops_hdd_after_boot={"osd_mclock_max_capacity_iops_hdd":"315.000000"}' 2026-02-17T12:29:15.595 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:960: test_activate_osd_skip_benchmark: get_asok_path osd.0 2026-02-17T12:29:15.595 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:29:15.595 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:29:15.596 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:15.596 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:15.596 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:15.596 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.0.asok 2026-02-17T12:29:15.596 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:960: test_activate_osd_skip_benchmark: CEPH_ARGS= 2026-02-17T12:29:15.596 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:960: test_activate_osd_skip_benchmark: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-osd.0.asok config get osd_mclock_max_capacity_iops_ssd 2026-02-17T12:29:15.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:960: test_activate_osd_skip_benchmark: local 'max_iops_ssd_after_boot={"osd_mclock_max_capacity_iops_ssd":"21500.000000"}' 2026-02-17T12:29:15.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:962: test_activate_osd_skip_benchmark: test '{"osd_mclock_max_capacity_iops_hdd":"315.000000"}' = '{"osd_mclock_max_capacity_iops_hdd":"315.000000"}' 2026-02-17T12:29:15.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: test_activate_osd_skip_benchmark: test '{"osd_mclock_max_capacity_iops_ssd":"21500.000000"}' = '{"osd_mclock_max_capacity_iops_ssd":"21500.000000"}' 2026-02-17T12:29:15.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:965: test_activate_osd_skip_benchmark: teardown td/ceph-helpers 2026-02-17T12:29:15.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:15.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:15.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:15.643 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:15.643 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:15.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:15.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:15.644 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:15.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:15.749 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:15.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:15.750 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:15.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:15.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:15.752 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:15.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:15.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:15.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:15.754 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:15.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:15.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:15.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:15.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:15.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:15.759 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:15.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_destroy_osd td/ceph-helpers 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:796: test_destroy_osd: local dir=td/ceph-helpers 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:798: test_destroy_osd: setup td/ceph-helpers 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:15.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:15.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:15.762 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:15.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:15.763 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:15.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:15.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:15.764 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:15.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:15.766 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:15.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:15.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:15.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:15.768 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:15.768 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:15.768 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:15.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:15.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:15.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:15.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:29:15.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:29:15.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:15.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:15.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:29:15.772 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:29:15.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:29:15.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:29:15.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:29:15.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:799: test_destroy_osd: run_mon td/ceph-helpers a 2026-02-17T12:29:15.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:29:15.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:29:15.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:29:15.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:29:15.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:29:15.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-17T12:29:15.791 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:29:15.792 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:15.792 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:15.792 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:15.792 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:15.792 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:15.792 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:15.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:29:15.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:29:15.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:29:15.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:15.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:15.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:29:15.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:29:15.819 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:15.819 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:15.819 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:15.819 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:15.819 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:15.819 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:15.819 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:15.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:15.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:29:15.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:29:15.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:15.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:15.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:29:15.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:29:15.867 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:15.867 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:15.867 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:15.867 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:15.868 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:15.868 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:15.868 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:15.868 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:15.868 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:29:15.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:800: test_destroy_osd: run_mgr td/ceph-helpers x 2026-02-17T12:29:15.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:29:15.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:29:15.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:29:15.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:29:15.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:29:15.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:29:16.007 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:29:16.007 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:16.007 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:16.007 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:16.007 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:16.007 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:16.007 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:16.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:16.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:16.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:801: test_destroy_osd: run_osd td/ceph-helpers 0 2026-02-17T12:29:16.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:29:16.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:29:16.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:29:16.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:29:16.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:29:16.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:29:16.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:29:16.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:29:16.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:16.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=5706420f-564c-4e9a-833d-155e19e3f944 2026-02-17T12:29:16.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 5706420f-564c-4e9a-833d-155e19e3f944' 2026-02-17T12:29:16.031 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 5706420f-564c-4e9a-833d-155e19e3f944 2026-02-17T12:29:16.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:29:16.039 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAcX5RpKeFJAhAAGukWIxUbUBSvOvt1CPpYaA== 2026-02-17T12:29:16.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAcX5RpKeFJAhAAGukWIxUbUBSvOvt1CPpYaA=="}' 2026-02-17T12:29:16.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 5706420f-564c-4e9a-833d-155e19e3f944 -i td/ceph-helpers/0/new.json 2026-02-17T12:29:16.143 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:16.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:29:16.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAcX5RpKeFJAhAAGukWIxUbUBSvOvt1CPpYaA== --osd-uuid 5706420f-564c-4e9a-833d-155e19e3f944 2026-02-17T12:29:16.169 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:16.167+0000 7f352c2e9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:16.170 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:16.169+0000 7f352c2e9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:16.172 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:16.169+0000 7f352c2e9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:16.172 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:16.170+0000 7f352c2e9780 -1 bdev(0x563b65c07c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:29:16.172 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:16.170+0000 7f352c2e9780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:29:19.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:29:19.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:29:19.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:29:19.059 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:29:19.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:29:19.315 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:29:19.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:29:19.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:29:19.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:29:19.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:29:19.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:29:19.332 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:19.330+0000 7f4116dd4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:19.333 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:19.332+0000 7f4116dd4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:19.334 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:19.333+0000 7f4116dd4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:19.508 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:29:19.508 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:29:19.508 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:29:19.508 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:29:19.508 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:29:19.508 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:19.508 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:29:19.508 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:19.508 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:19.508 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:19.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:20.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:20.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:20.703 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:29:20.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:29:20.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:20.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:20.895 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:20.926 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:20.924+0000 7f4116dd4780 -1 Falling back to public interface 2026-02-17T12:29:21.896 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:21.896 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:21.897 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:29:21.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:29:21.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:21.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:22.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:23.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:23.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:23.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:29:23.087 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:29:23.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:23.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:23.279 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:23.875 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:23.874+0000 7f4116dd4780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:29:24.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:24.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:24.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:29:24.282 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:29:24.282 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:24.283 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:24.474 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3292983823,v1:127.0.0.1:6803/3292983823] [v2:127.0.0.1:6804/3292983823,v1:127.0.0.1:6805/3292983823] exists,up 5706420f-564c-4e9a-833d-155e19e3f944 2026-02-17T12:29:24.474 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:29:24.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:29:24.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:29:24.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:802: test_destroy_osd: destroy_osd td/ceph-helpers 0 2026-02-17T12:29:24.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:784: destroy_osd: local dir=td/ceph-helpers 2026-02-17T12:29:24.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:785: destroy_osd: local id=0 2026-02-17T12:29:24.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:787: destroy_osd: ceph osd out osd.0 2026-02-17T12:29:24.719 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 is already out. 2026-02-17T12:29:24.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:788: destroy_osd: kill_daemons td/ceph-helpers TERM osd.0 2026-02-17T12:29:24.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:24.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:24.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:24.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:24.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:26.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:26.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:789: destroy_osd: ceph osd down osd.0 2026-02-17T12:29:26.227 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 is already down. 2026-02-17T12:29:26.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:790: destroy_osd: ceph osd purge osd.0 --yes-i-really-mean-it 2026-02-17T12:29:26.422 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 does not exist 2026-02-17T12:29:26.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:791: destroy_osd: teardown td/ceph-helpers/0 2026-02-17T12:29:26.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers/0 2026-02-17T12:29:26.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:26.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers/0 KILL 2026-02-17T12:29:26.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:26.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:26.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:26.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:26.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:26.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:26.432 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:26.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:26.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:26.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:26.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:26.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:26.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:26.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:26.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:26.436 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:26.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:26.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:26.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers/0 2026-02-17T12:29:26.439 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:26.439 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:26.439 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:26.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:26.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:26.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:26.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:792: destroy_osd: rm -fr td/ceph-helpers/0 2026-02-17T12:29:26.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:803: test_destroy_osd: ceph osd dump 2026-02-17T12:29:26.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:803: test_destroy_osd: grep 'osd. ' 2026-02-17T12:29:26.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:804: test_destroy_osd: teardown td/ceph-helpers 2026-02-17T12:29:26.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:26.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:26.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:26.632 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:26.632 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:26.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:26.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:26.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:26.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:26.738 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:26.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:26.739 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:26.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:26.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:26.741 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:26.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:26.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:26.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:26.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:26.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:26.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:26.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:26.746 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:26.746 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:26.746 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:26.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:26.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:26.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:26.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:29:26.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_display_logs td/ceph-helpers 2026-02-17T12:29:26.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2165: test_display_logs: local dir=td/ceph-helpers 2026-02-17T12:29:26.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2167: test_display_logs: setup td/ceph-helpers 2026-02-17T12:29:26.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:29:26.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:29:26.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:26.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:26.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:26.749 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:26.749 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:26.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:26.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:26.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:26.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:26.751 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:26.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:26.751 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:26.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:26.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:26.752 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:26.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:26.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:26.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:26.753 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:26.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:26.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:26.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:26.756 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:26.756 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:26.756 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:26.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:26.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:26.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:26.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:29:26.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:29:26.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:26.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:26.758 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:29:26.759 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:29:26.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:29:26.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:29:26.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:29:26.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2168: test_display_logs: run_mon td/ceph-helpers a 2026-02-17T12:29:26.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:29:26.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:29:26.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:29:26.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:29:26.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:29:26.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-17T12:29:26.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:29:26.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:26.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:26.780 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:26.780 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:26.780 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:26.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:26.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:29:26.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:29:26.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:29:26.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:26.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:26.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:29:26.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:29:26.811 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:26.811 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:26.811 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:26.811 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:26.811 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:26.811 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:26.811 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:26.812 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:26.812 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:29:26.852 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:29:26.853 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:26.853 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:26.853 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:29:26.853 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:29:26.854 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:26.854 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:26.854 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:26.854 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:26.854 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:26.854 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:26.854 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:26.854 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:26.854 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:29:26.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2169: test_display_logs: kill_daemons td/ceph-helpers 2026-02-17T12:29:26.897 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:26.897 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:26.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:26.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:26.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:27.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:27.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2170: test_display_logs: display_logs td/ceph-helpers 2026-02-17T12:29:27.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: display_logs: local dir=td/ceph-helpers 2026-02-17T12:29:27.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2157: display_logs: find td/ceph-helpers -maxdepth 1 -name '*.log' 2026-02-17T12:29:27.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2158: display_logs: read file 2026-02-17T12:29:27.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2159: display_logs: echo '======================= td/ceph-helpers/mon.a.log' 2026-02-17T12:29:27.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2160: display_logs: cat td/ceph-helpers/mon.a.log 2026-02-17T12:29:27.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2158: display_logs: read file 2026-02-17T12:29:27.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2171: test_display_logs: grep --quiet mon.a.log td/ceph-helpers/log.out 2026-02-17T12:29:27.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2172: test_display_logs: teardown td/ceph-helpers 2026-02-17T12:29:27.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:27.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:27.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:27.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:27.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:27.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:27.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:27.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:27.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:27.010 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:27.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:27.011 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:27.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:27.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:27.012 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:27.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:27.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:27.013 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:27.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:27.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:27.016 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:27.017 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.017 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.017 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:27.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:27.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:27.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:29:27.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_erasure_code_plugin_exists td/ceph-helpers 2026-02-17T12:29:27.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2136: test_erasure_code_plugin_exists: local dir=td/ceph-helpers 2026-02-17T12:29:27.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2138: test_erasure_code_plugin_exists: setup td/ceph-helpers 2026-02-17T12:29:27.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:29:27.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:29:27.020 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:27.020 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:27.020 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:27.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:27.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:27.020 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:27.020 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:27.020 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:27.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:27.021 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:27.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:27.021 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:27.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:27.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:27.022 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:27.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:27.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:27.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:27.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:27.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:27.026 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:27.026 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.026 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:27.027 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:27.027 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:27.027 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:29:27.028 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:29:27.028 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.028 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:29:27.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:29:27.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:29:27.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:29:27.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:29:27.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2139: test_erasure_code_plugin_exists: run_mon td/ceph-helpers a 2026-02-17T12:29:27.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:29:27.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:29:27.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:29:27.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:29:27.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:29:27.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-17T12:29:27.051 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:29:27.051 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:27.051 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:27.051 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:27.051 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.051 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.051 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:27.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:29:27.077 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:29:27.078 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:29:27.078 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:27.078 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:27.078 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:29:27.078 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:29:27.078 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:27.078 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:27.078 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:27.079 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:27.079 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.080 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.080 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:27.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:27.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:29:27.127 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:29:27.128 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:27.128 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:27.128 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:29:27.128 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:29:27.128 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:27.128 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:27.128 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:27.128 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:27.128 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.129 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.129 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:27.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:27.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:29:27.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2140: test_erasure_code_plugin_exists: run_mgr td/ceph-helpers x 2026-02-17T12:29:27.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:29:27.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:29:27.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:29:27.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:29:27.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:29:27.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:29:27.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:29:27.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:27.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:27.271 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:27.271 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.271 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:27.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:27.272 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:27.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2141: test_erasure_code_plugin_exists: erasure_code_plugin_exists jerasure 2026-02-17T12:29:27.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2114: erasure_code_plugin_exists: local plugin=jerasure 2026-02-17T12:29:27.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2115: erasure_code_plugin_exists: local status 2026-02-17T12:29:27.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2116: erasure_code_plugin_exists: local grepstr 2026-02-17T12:29:27.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2117: erasure_code_plugin_exists: local s 2026-02-17T12:29:27.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2118: erasure_code_plugin_exists: case `uname` in 2026-02-17T12:29:27.291 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2118: erasure_code_plugin_exists: uname 2026-02-17T12:29:27.292 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2120: erasure_code_plugin_exists: grepstr='jerasure.*No such file' 2026-02-17T12:29:27.292 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2123: erasure_code_plugin_exists: ceph osd erasure-code-profile set TESTPROFILE plugin=jerasure 2026-02-17T12:29:27.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2123: erasure_code_plugin_exists: s= 2026-02-17T12:29:27.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2124: erasure_code_plugin_exists: local status=0 2026-02-17T12:29:27.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2125: erasure_code_plugin_exists: '[' 0 -eq 0 ']' 2026-02-17T12:29:27.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2126: erasure_code_plugin_exists: ceph osd erasure-code-profile rm TESTPROFILE 2026-02-17T12:29:27.570 INFO:tasks.workunit.client.0.trial155.stderr:erasure-code-profile TESTPROFILE does not exist 2026-02-17T12:29:27.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2132: erasure_code_plugin_exists: return 0 2026-02-17T12:29:27.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2142: test_erasure_code_plugin_exists: erasure_code_plugin_exists FAKE 2026-02-17T12:29:27.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2114: erasure_code_plugin_exists: local plugin=FAKE 2026-02-17T12:29:27.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2115: erasure_code_plugin_exists: local status 2026-02-17T12:29:27.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2116: erasure_code_plugin_exists: local grepstr 2026-02-17T12:29:27.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2117: erasure_code_plugin_exists: local s 2026-02-17T12:29:27.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2118: erasure_code_plugin_exists: case `uname` in 2026-02-17T12:29:27.579 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2118: erasure_code_plugin_exists: uname 2026-02-17T12:29:27.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2120: erasure_code_plugin_exists: grepstr='FAKE.*No such file' 2026-02-17T12:29:27.580 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2123: erasure_code_plugin_exists: ceph osd erasure-code-profile set TESTPROFILE plugin=FAKE 2026-02-17T12:29:27.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2123: erasure_code_plugin_exists: s='Error EIO: load dlopen(/usr/lib64/ceph/erasure-code/libec_FAKE.so): /usr/lib64/ceph/erasure-code/libec_FAKE.so: cannot open shared object file: No such file or directory' 2026-02-17T12:29:27.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2124: erasure_code_plugin_exists: local status=5 2026-02-17T12:29:27.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2125: erasure_code_plugin_exists: '[' 5 -eq 0 ']' 2026-02-17T12:29:27.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2127: erasure_code_plugin_exists: echo Error EIO: load 'dlopen(/usr/lib64/ceph/erasure-code/libec_FAKE.so):' /usr/lib64/ceph/erasure-code/libec_FAKE.so: cannot open shared object file: No such file or directory 2026-02-17T12:29:27.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2127: erasure_code_plugin_exists: grep --quiet 'FAKE.*No such file' 2026-02-17T12:29:27.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2132: erasure_code_plugin_exists: return 5 2026-02-17T12:29:27.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2143: test_erasure_code_plugin_exists: teardown td/ceph-helpers 2026-02-17T12:29:27.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:27.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:27.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:27.665 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:27.665 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:27.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:27.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:27.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:27.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:27.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:27.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:27.771 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:27.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:27.773 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:27.773 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:27.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:27.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:27.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.775 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:27.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:27.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:27.778 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:27.778 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.778 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:27.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:27.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:27.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:29:27.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_expect_failure td/ceph-helpers 2026-02-17T12:29:27.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2046: test_expect_failure: local dir=td/ceph-helpers 2026-02-17T12:29:27.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2048: test_expect_failure: setup td/ceph-helpers 2026-02-17T12:29:27.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:29:27.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:29:27.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:27.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:27.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:27.781 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:27.781 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:27.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:27.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:27.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:27.782 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:27.782 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:27.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:27.783 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:27.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:27.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:27.784 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:27.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:27.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:27.785 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:27.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:27.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:27.788 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:27.788 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.788 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:27.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:27.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:27.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:29:27.790 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:29:27.790 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.790 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:29:27.791 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:29:27.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:29:27.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:29:27.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:29:27.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2049: test_expect_failure: expect_failure td/ceph-helpers FAIL bash -c 'echo FAIL ; exit 1' 2026-02-17T12:29:27.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: local dir=td/ceph-helpers 2026-02-17T12:29:27.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2026: expect_failure: shift 2026-02-17T12:29:27.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2027: expect_failure: local expected=FAIL 2026-02-17T12:29:27.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: shift 2026-02-17T12:29:27.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: local success 2026-02-17T12:29:27.793 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2031: expect_failure: bash -c 'echo FAIL ; exit 1' 2026-02-17T12:29:27.794 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: expect_failure: success=false 2026-02-17T12:29:27.794 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: false 2026-02-17T12:29:27.794 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: grep --quiet FAIL td/ceph-helpers/out 2026-02-17T12:29:27.794 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2041: expect_failure: return 0 2026-02-17T12:29:27.794 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2051: test_expect_failure: expect_failure td/ceph-helpers FAIL bash -c 'echo FAIL ; exit 0' 2026-02-17T12:29:27.794 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: local dir=td/ceph-helpers 2026-02-17T12:29:27.794 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2026: expect_failure: shift 2026-02-17T12:29:27.794 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2027: expect_failure: local expected=FAIL 2026-02-17T12:29:27.795 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: shift 2026-02-17T12:29:27.795 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: local success 2026-02-17T12:29:27.795 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2031: expect_failure: bash -c 'echo FAIL ; exit 0' 2026-02-17T12:29:27.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: success=true 2026-02-17T12:29:27.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: true 2026-02-17T12:29:27.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2038: expect_failure: cat td/ceph-helpers/out 2026-02-17T12:29:27.796 INFO:tasks.workunit.client.0.trial155.stderr:FAIL 2026-02-17T12:29:27.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2039: expect_failure: return 1 2026-02-17T12:29:27.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2052: test_expect_failure: grep --quiet FAIL td/ceph-helpers/out 2026-02-17T12:29:27.797 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2054: test_expect_failure: expect_failure td/ceph-helpers FAIL bash -c 'echo UNEXPECTED ; exit 1' 2026-02-17T12:29:27.797 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: local dir=td/ceph-helpers 2026-02-17T12:29:27.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2026: expect_failure: shift 2026-02-17T12:29:27.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2027: expect_failure: local expected=FAIL 2026-02-17T12:29:27.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: shift 2026-02-17T12:29:27.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: local success 2026-02-17T12:29:27.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2031: expect_failure: bash -c 'echo UNEXPECTED ; exit 1' 2026-02-17T12:29:27.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: expect_failure: success=false 2026-02-17T12:29:27.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: false 2026-02-17T12:29:27.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: grep --quiet FAIL td/ceph-helpers/out 2026-02-17T12:29:27.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2038: expect_failure: cat td/ceph-helpers/out 2026-02-17T12:29:27.799 INFO:tasks.workunit.client.0.trial155.stderr:UNEXPECTED 2026-02-17T12:29:27.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2039: expect_failure: return 1 2026-02-17T12:29:27.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2055: test_expect_failure: grep --quiet FAIL td/ceph-helpers/out 2026-02-17T12:29:27.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2056: test_expect_failure: teardown td/ceph-helpers 2026-02-17T12:29:27.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:27.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:27.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:27.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:27.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:27.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:27.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:27.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:27.802 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:27.803 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:27.803 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:27.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:27.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:27.804 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:27.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:27.805 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:27.806 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:27.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:27.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:27.808 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:27.808 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:27.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:27.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_flush_pg_stats td/ceph-helpers 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2288: test_flush_pg_stats: local dir=td/ceph-helpers 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2290: test_flush_pg_stats: setup td/ceph-helpers 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:27.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:27.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:27.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:27.812 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:27.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:27.813 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:27.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:27.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:27.814 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:27.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:27.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:27.815 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:27.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:27.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:27.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:27.817 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:27.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:27.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:27.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:27.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:29:27.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:29:27.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:29:27.821 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:29:27.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:29:27.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:29:27.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:29:27.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2291: test_flush_pg_stats: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:29:27.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:29:27.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:29:27.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:29:27.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:29:27.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:29:27.823 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:29:27.842 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:29:27.842 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:27.843 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:27.843 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:27.843 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.843 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.843 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:27.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:29:27.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:29:27.870 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:29:27.870 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:27.871 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:27.871 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:29:27.871 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:29:27.871 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:27.871 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:27.871 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:27.872 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:27.872 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.872 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.872 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:27.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:27.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:29:27.914 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:29:27.915 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:27.915 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:27.915 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:29:27.915 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:29:27.916 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:27.916 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:27.916 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:27.916 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:27.916 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:27.917 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:27.917 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:27.917 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:27.917 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:29:27.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2292: test_flush_pg_stats: run_mgr td/ceph-helpers x 2026-02-17T12:29:27.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:29:27.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:29:27.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:29:27.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:29:27.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:29:27.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:29:28.060 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:29:28.061 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:28.061 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:28.061 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:28.061 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:28.061 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:28.061 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:28.061 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:28.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:28.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2293: test_flush_pg_stats: run_osd td/ceph-helpers 0 2026-02-17T12:29:28.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:29:28.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:29:28.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:29:28.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:29:28.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:29:28.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:28.082 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:29:28.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:29:28.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:29:28.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:29:28.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:29:28.084 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:29:28.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=8a8b3135-2239-4d58-bca3-4aa958a263f4 2026-02-17T12:29:28.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 8a8b3135-2239-4d58-bca3-4aa958a263f4' 2026-02-17T12:29:28.084 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 8a8b3135-2239-4d58-bca3-4aa958a263f4 2026-02-17T12:29:28.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:29:28.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAoX5RpAKKIBRAAS4kWk5LRbLLDs3htAPlARw== 2026-02-17T12:29:28.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAoX5RpAKKIBRAAS4kWk5LRbLLDs3htAPlARw=="}' 2026-02-17T12:29:28.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 8a8b3135-2239-4d58-bca3-4aa958a263f4 -i td/ceph-helpers/0/new.json 2026-02-17T12:29:28.198 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:28.205 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:29:28.206 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAoX5RpAKKIBRAAS4kWk5LRbLLDs3htAPlARw== --osd-uuid 8a8b3135-2239-4d58-bca3-4aa958a263f4 2026-02-17T12:29:28.225 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:28.224+0000 7feef1618780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:28.226 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:28.225+0000 7feef1618780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:28.227 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:28.226+0000 7feef1618780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:28.228 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:28.226+0000 7feef1618780 -1 bdev(0x55d0a687bc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:29:28.228 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:28.226+0000 7feef1618780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:29:31.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:29:31.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:29:31.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:29:31.121 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:29:31.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:29:31.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:29:31.376 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:29:31.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:29:31.377 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:29:31.377 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:29:31.377 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:29:31.392 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:31.391+0000 7f96e561f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:31.393 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:31.392+0000 7f96e561f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:31.394 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:31.393+0000 7f96e561f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:31.568 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:29:31.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:29:31.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:29:31.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:29:31.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:29:31.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:31.569 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:31.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:29:31.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:31.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:31.758 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:32.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:32.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:32.760 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:29:32.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:29:32.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:32.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:32.950 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:32.984 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:32.982+0000 7f96e561f780 -1 Falling back to public interface 2026-02-17T12:29:33.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:33.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:33.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:29:33.952 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:29:33.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:33.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:34.145 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:35.147 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:35.148 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:35.148 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:29:35.149 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:29:35.149 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:35.149 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:35.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:35.684 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:35.683+0000 7f96e561f780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:29:36.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:36.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:36.339 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:29:36.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:29:36.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:36.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:36.527 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/32515102,v1:127.0.0.1:6803/32515102] [v2:127.0.0.1:6804/32515102,v1:127.0.0.1:6805/32515102] exists,up 8a8b3135-2239-4d58-bca3-4aa958a263f4 2026-02-17T12:29:36.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:29:36.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:29:36.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:29:36.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2294: test_flush_pg_stats: create_rbd_pool 2026-02-17T12:29:36.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:29:36.709 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:29:36.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:29:36.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:29:36.992 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:29:36.999 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:29:38.000 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:29:38.282 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2295: test_flush_pg_stats: rados -p rbd put obj /etc/group 2026-02-17T12:29:38.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2296: test_flush_pg_stats: flush_pg_stats 2026-02-17T12:29:38.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:29:38.301 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:29:38.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:29:38.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:29:38.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:29:38.492 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:29:38.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836483 2026-02-17T12:29:38.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836483 2026-02-17T12:29:38.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T12:29:38.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:29:38.556 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836483 2026-02-17T12:29:38.556 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:29:38.557 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:29:38.557 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836483 2026-02-17T12:29:38.558 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:29:38.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836483 2026-02-17T12:29:38.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T12:29:38.559 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836483 2026-02-17T12:29:38.559 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:29:38.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:29:38.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:29:39.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:29:39.749 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:29:39.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:29:39.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:29:40.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:29:40.938 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:29:41.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T12:29:41.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2297: test_flush_pg_stats: local 'jq_filter=.pools | .[] | select(.name == "rbd") | .stats' 2026-02-17T12:29:41.127 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: test_flush_pg_stats: ceph df detail --format=json 2026-02-17T12:29:41.127 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: test_flush_pg_stats: jq '.pools | .[] | select(.name == "rbd") | .stats.stored' 2026-02-17T12:29:41.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2298: test_flush_pg_stats: stored=8139 2026-02-17T12:29:41.382 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: test_flush_pg_stats: ceph df detail --format=json 2026-02-17T12:29:41.382 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: test_flush_pg_stats: jq '.pools | .[] | select(.name == "rbd") | .stats.stored_raw' 2026-02-17T12:29:41.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2299: test_flush_pg_stats: stored_raw=8139 2026-02-17T12:29:41.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2300: test_flush_pg_stats: test 8139 -gt 0 2026-02-17T12:29:41.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2301: test_flush_pg_stats: test 8139 == 8139 2026-02-17T12:29:41.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2302: test_flush_pg_stats: teardown td/ceph-helpers 2026-02-17T12:29:41.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:41.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:41.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:41.636 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:41.636 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:41.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:41.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:41.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:41.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:41.741 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:41.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:41.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:41.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:41.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:41.744 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:41.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:41.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:41.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:41.746 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:41.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:41.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:41.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:41.751 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:41.751 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:41.752 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:41.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_config td/ceph-helpers 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1136: test_get_config: local dir=td/ceph-helpers 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1139: test_get_config: setup td/ceph-helpers 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:41.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:41.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:41.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:41.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:41.755 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:41.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:41.756 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:41.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:41.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:41.757 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:41.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:41.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:41.758 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:41.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:41.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:41.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:41.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:41.761 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:41.761 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:41.761 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:41.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:41.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:41.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:41.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:29:41.763 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:29:41.763 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:41.763 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:41.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:29:41.764 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:29:41.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:29:41.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:29:41.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:29:41.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1140: test_get_config: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:29:41.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:29:41.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:29:41.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:29:41.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:29:41.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:29:41.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:29:41.785 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:29:41.785 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:41.785 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:41.785 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:41.785 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:41.785 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:41.785 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:41.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:29:41.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:29:41.815 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:29:41.816 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:41.816 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:41.816 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:29:41.816 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:29:41.816 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:41.816 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:41.817 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:41.817 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:41.817 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:41.817 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:41.817 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:41.817 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:41.817 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:29:41.859 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:29:41.860 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:41.860 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:41.860 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:29:41.860 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:29:41.860 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:41.860 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:41.860 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:41.860 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:41.860 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:41.860 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:41.860 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:41.861 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:41.861 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:29:41.905 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1141: test_get_config: get_config mon a osd_pool_default_size 2026-02-17T12:29:41.905 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:41.905 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:41.905 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=osd_pool_default_size 2026-02-17T12:29:41.905 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .osd_pool_default_size 2026-02-17T12:29:41.905 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:41.905 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:41.905 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:41.905 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:41.906 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:41.906 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:41.906 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:41.906 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:41.906 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get osd_pool_default_size 2026-02-17T12:29:41.946 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1141: test_get_config: test 1 = 1 2026-02-17T12:29:41.946 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1142: test_get_config: run_mgr td/ceph-helpers x 2026-02-17T12:29:41.946 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:29:41.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:29:41.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:29:41.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:29:41.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:29:41.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:29:42.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:29:42.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:42.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:42.044 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:42.044 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:42.044 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:42.044 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:42.044 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:42.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1143: test_get_config: run_osd td/ceph-helpers 0 --osd_max_scrubs=3 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:29:42.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:29:42.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:29:42.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:29:42.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:29:42.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_max_scrubs=3 2026-02-17T12:29:42.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:29:42.063 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:29:42.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=db9aed75-a9b2-473f-af2b-ef0ceb60c55c 2026-02-17T12:29:42.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 db9aed75-a9b2-473f-af2b-ef0ceb60c55c' 2026-02-17T12:29:42.064 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 db9aed75-a9b2-473f-af2b-ef0ceb60c55c 2026-02-17T12:29:42.064 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:29:42.075 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA2X5Rp9+poBBAArSH8jJbtXfazkxlGK4v0bg== 2026-02-17T12:29:42.075 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA2X5Rp9+poBBAArSH8jJbtXfazkxlGK4v0bg=="}' 2026-02-17T12:29:42.075 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new db9aed75-a9b2-473f-af2b-ef0ceb60c55c -i td/ceph-helpers/0/new.json 2026-02-17T12:29:42.179 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:42.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:29:42.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_max_scrubs=3 --mkfs --key AQA2X5Rp9+poBBAArSH8jJbtXfazkxlGK4v0bg== --osd-uuid db9aed75-a9b2-473f-af2b-ef0ceb60c55c 2026-02-17T12:29:42.204 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:42.202+0000 7f16ec195780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:42.205 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:42.204+0000 7f16ec195780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:42.206 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:42.205+0000 7f16ec195780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:42.207 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:42.205+0000 7f16ec195780 -1 bdev(0x561bf356dc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:29:42.207 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:42.205+0000 7f16ec195780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:29:45.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:29:45.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:29:45.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:29:45.088 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:29:45.089 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:29:45.352 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:29:45.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:29:45.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_max_scrubs=3 2026-02-17T12:29:45.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:29:45.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:29:45.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:29:45.370 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:45.368+0000 7fcd75418780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:45.371 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:45.369+0000 7fcd75418780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:45.372 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:45.370+0000 7fcd75418780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:45.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:29:45.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:29:45.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:29:45.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:29:45.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:29:45.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:45.543 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:45.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:29:45.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:45.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:45.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:46.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:46.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:46.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:29:46.737 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:29:46.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:46.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:46.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:46.983 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:46.982+0000 7fcd75418780 -1 Falling back to public interface 2026-02-17T12:29:47.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:47.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:47.927 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:29:47.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:29:47.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:47.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:48.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:49.118 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:49.118 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:49.118 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:29:49.119 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:29:49.119 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:49.119 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:49.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:49.700 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:49.699+0000 7fcd75418780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:29:50.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:50.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:50.310 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:29:50.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:29:50.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:50.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:50.499 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4294367190,v1:127.0.0.1:6803/4294367190] [v2:127.0.0.1:6804/4294367190,v1:127.0.0.1:6805/4294367190] exists,up db9aed75-a9b2-473f-af2b-ef0ceb60c55c 2026-02-17T12:29:50.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:29:50.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:29:50.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:29:50.501 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1144: test_get_config: get_config osd 0 osd_max_scrubs 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=osd 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=0 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=osd_max_scrubs 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .osd_max_scrubs 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path osd.0 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.0.asok 2026-02-17T12:29:50.502 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:50.503 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-osd.0.asok config get osd_max_scrubs 2026-02-17T12:29:50.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1144: test_get_config: test 3 = 3 2026-02-17T12:29:50.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1145: test_get_config: teardown td/ceph-helpers 2026-02-17T12:29:50.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:50.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:50.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:50.550 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:50.550 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:50.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:50.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:50.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:50.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:50.656 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:50.656 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:50.657 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:50.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:50.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:50.659 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:50.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:50.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:50.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:50.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:50.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:50.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:50.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:50.665 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:50.665 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:50.665 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:50.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:50.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:50.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:50.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:29:50.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_is_making_recovery_progress td/ceph-helpers 2026-02-17T12:29:50.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1344: test_get_is_making_recovery_progress: local dir=td/ceph-helpers 2026-02-17T12:29:50.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1346: test_get_is_making_recovery_progress: setup td/ceph-helpers 2026-02-17T12:29:50.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:29:50.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:29:50.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:50.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:50.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:50.668 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:50.668 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:50.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:50.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:50.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:50.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:50.669 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:50.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:50.670 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:50.671 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:50.671 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:50.671 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:50.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:50.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:50.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:50.672 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:50.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:50.674 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:50.674 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:50.675 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:50.675 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:50.675 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:50.675 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:50.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:50.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:50.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:29:50.677 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:29:50.677 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:50.677 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:50.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:29:50.678 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:29:50.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:29:50.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:29:50.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:29:50.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1347: test_get_is_making_recovery_progress: run_mon td/ceph-helpers a 2026-02-17T12:29:50.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:29:50.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:29:50.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:29:50.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:29:50.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:29:50.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-17T12:29:50.700 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:29:50.701 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:50.701 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:50.701 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:50.701 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:50.701 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:50.701 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:50.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:29:50.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:29:50.726 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:29:50.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:50.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:50.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:29:50.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:29:50.728 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:50.728 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:50.728 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:50.729 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:50.729 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:50.729 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:50.729 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:50.729 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:50.729 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:29:50.774 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:29:50.774 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:50.774 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:50.774 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:29:50.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:29:50.775 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:50.775 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:50.775 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:50.775 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:50.775 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:50.775 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:50.775 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:50.776 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:50.776 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:29:50.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1348: test_get_is_making_recovery_progress: run_mgr td/ceph-helpers x 2026-02-17T12:29:50.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:29:50.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:29:50.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:29:50.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:29:50.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:29:50.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:29:50.923 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:29:50.923 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:50.923 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:50.924 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:50.924 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:50.924 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:50.924 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:50.924 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:50.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:50.942 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1349: test_get_is_making_recovery_progress: get_is_making_recovery_progress 2026-02-17T12:29:50.943 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:29:50.943 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:29:50.943 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:29:50.943 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:29:50.943 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:29:50.943 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:29:51.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:29:51.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:29:51.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1350: test_get_is_making_recovery_progress: teardown td/ceph-helpers 2026-02-17T12:29:51.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:51.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:51.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:51.045 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:51.045 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:51.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:51.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:51.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:51.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:51.151 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:51.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:51.152 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:51.153 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:51.153 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:51.154 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:51.154 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:51.155 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:51.155 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:51.155 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:51.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:51.157 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:51.157 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:51.158 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:51.158 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:51.158 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:51.159 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:51.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:51.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_last_scrub_stamp td/ceph-helpers 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1533: test_get_last_scrub_stamp: local dir=td/ceph-helpers 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1535: test_get_last_scrub_stamp: setup td/ceph-helpers 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:29:51.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:29:51.162 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:29:51.162 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:29:51.162 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:29:51.162 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:29:51.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:29:51.163 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:29:51.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:29:51.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:29:51.164 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:29:51.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:51.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:29:51.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:29:51.165 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:29:51.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:29:51.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:29:51.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:29:51.168 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:29:51.168 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:51.168 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:51.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:29:51.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:29:51.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:29:51.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:29:51.170 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:29:51.170 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:51.170 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:51.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:29:51.171 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:29:51.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:29:51.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:29:51.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:29:51.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1536: test_get_last_scrub_stamp: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:29:51.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:29:51.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:29:51.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:29:51.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:29:51.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:29:51.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:29:51.192 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:29:51.192 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:51.192 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:51.192 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:51.192 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:51.192 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:51.192 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:51.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:29:51.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:29:51.219 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:29:51.219 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:51.219 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:51.219 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:29:51.219 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:29:51.220 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:51.220 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:51.220 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:51.221 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:51.221 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:51.221 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:51.221 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:51.221 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:51.221 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:29:51.266 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:29:51.266 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:29:51.266 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:29:51.266 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:29:51.266 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:29:51.266 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:29:51.266 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:29:51.266 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:29:51.266 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:29:51.266 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:51.267 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:51.267 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:29:51.267 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:29:51.267 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:29:51.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1537: test_get_last_scrub_stamp: run_mgr td/ceph-helpers x 2026-02-17T12:29:51.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:29:51.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:29:51.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:29:51.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:29:51.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:29:51.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:29:51.409 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:29:51.409 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:51.410 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:51.410 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:51.410 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:51.410 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:51.410 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:51.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:51.411 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:29:51.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1538: test_get_last_scrub_stamp: run_osd td/ceph-helpers 0 2026-02-17T12:29:51.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:29:51.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:29:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:29:51.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:29:51.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:29:51.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:29:51.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:29:51.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:29:51.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:29:51.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:29:51.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:29:51.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:29:51.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=1d197e80-0172-4d22-9cf9-e8ef6dbc4afb 2026-02-17T12:29:51.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 1d197e80-0172-4d22-9cf9-e8ef6dbc4afb' 2026-02-17T12:29:51.435 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 1d197e80-0172-4d22-9cf9-e8ef6dbc4afb 2026-02-17T12:29:51.435 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:29:51.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA/X5Rpm8VRGhAAFJ1ejyJxN/Jqotx2dixvuA== 2026-02-17T12:29:51.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA/X5Rpm8VRGhAAFJ1ejyJxN/Jqotx2dixvuA=="}' 2026-02-17T12:29:51.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 1d197e80-0172-4d22-9cf9-e8ef6dbc4afb -i td/ceph-helpers/0/new.json 2026-02-17T12:29:51.545 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:51.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:29:51.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA/X5Rpm8VRGhAAFJ1ejyJxN/Jqotx2dixvuA== --osd-uuid 1d197e80-0172-4d22-9cf9-e8ef6dbc4afb 2026-02-17T12:29:51.570 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:51.569+0000 7f3ad0e0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:51.572 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:51.570+0000 7f3ad0e0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:51.572 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:51.571+0000 7f3ad0e0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:51.573 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:51.571+0000 7f3ad0e0d780 -1 bdev(0x55667c6c7c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:29:51.573 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:51.572+0000 7f3ad0e0d780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:29:53.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:29:53.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:29:53.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:29:53.984 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:29:53.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:29:54.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:29:54.246 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:29:54.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:29:54.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:29:54.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:29:54.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:29:54.262 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:54.260+0000 7fd825b93780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:54.263 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:54.262+0000 7fd825b93780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:54.264 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:54.262+0000 7fd825b93780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:29:54.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:29:54.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:29:54.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:29:54.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:29:54.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:29:54.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:54.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:29:54.435 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:29:54.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:54.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:54.619 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:55.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:55.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:55.621 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:29:55.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:29:55.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:55.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:55.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:55.850 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:55.848+0000 7fd825b93780 -1 Falling back to public interface 2026-02-17T12:29:56.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:56.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:56.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:29:56.819 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:29:56.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:56.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:57.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:58.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:58.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:58.007 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:29:58.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:29:58.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:58.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:58.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:29:58.801 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:29:58.799+0000 7fd825b93780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:29:59.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:29:59.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:29:59.196 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:29:59.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:29:59.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:29:59.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:29:59.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:00.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:00.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:00.389 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:30:00.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:30:00.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:00.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:00.577 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/156497237,v1:127.0.0.1:6803/156497237] [v2:127.0.0.1:6804/156497237,v1:127.0.0.1:6805/156497237] exists,up 1d197e80-0172-4d22-9cf9-e8ef6dbc4afb 2026-02-17T12:30:00.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:30:00.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:30:00.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:30:00.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1539: test_get_last_scrub_stamp: create_rbd_pool 2026-02-17T12:30:00.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:30:00.760 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:30:00.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:30:00.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:30:01.001 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:30:01.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:30:02.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:30:02.289 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1540: test_get_last_scrub_stamp: wait_for_clean 2026-02-17T12:30:02.289 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:30:02.289 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:30:02.289 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:30:02.289 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:30:02.290 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:30:02.290 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:30:02.290 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:30:02.290 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:30:02.290 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:30:02.372 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:30:02.372 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:30:02.372 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:30:02.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:30:02.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:30:02.373 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:30:02.565 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:30:02.565 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:30:02.565 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:30:02.565 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:30:02.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836483 2026-02-17T12:30:02.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836483 2026-02-17T12:30:02.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T12:30:02.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:30:02.631 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836483 2026-02-17T12:30:02.631 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:30:02.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:30:02.632 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836483 2026-02-17T12:30:02.632 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:30:02.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836483 2026-02-17T12:30:02.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T12:30:02.633 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836483 2026-02-17T12:30:02.634 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:30:02.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:30:02.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:30:03.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:30:03.823 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:30:04.018 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T12:30:04.019 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:30:04.019 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:30:04.019 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:30:04.272 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:30:04.272 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:30:04.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:30:04.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:30:04.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:30:04.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:30:04.273 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:30:04.273 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:30:04.465 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:30:04.466 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:30:04.466 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:30:04.466 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:30:04.713 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:30:04.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:30:04.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:30:04.714 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1541: test_get_last_scrub_stamp: get_last_scrub_stamp 1.0 2026-02-17T12:30:04.714 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:30:04.714 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:30:04.714 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:30:04.714 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:30:04.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1541: test_get_last_scrub_stamp: stamp=2026-02-17T12:30:00.952033+0000 2026-02-17T12:30:04.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1542: test_get_last_scrub_stamp: test -n 2026-02-17T12:30:00.952033+0000 2026-02-17T12:30:04.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1543: test_get_last_scrub_stamp: teardown td/ceph-helpers 2026-02-17T12:30:04.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:30:04.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:30:04.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:30:04.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:30:04.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:30:04.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:30:04.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:30:04.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:30:05.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:30:05.010 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:30:05.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:30:05.011 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:30:05.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:30:05.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:30:05.012 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:30:05.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:05.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:30:05.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:30:05.014 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:05.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:30:05.016 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:30:05.016 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:30:05.019 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:30:05.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:05.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:05.020 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_not_primary td/ceph-helpers 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1238: test_get_not_primary: local dir=td/ceph-helpers 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1240: test_get_not_primary: setup td/ceph-helpers 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:30:05.021 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:30:05.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:30:05.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:30:05.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:30:05.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:30:05.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:30:05.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:30:05.024 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:30:05.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:30:05.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:30:05.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:30:05.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:05.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:30:05.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:30:05.026 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:05.027 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:30:05.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:30:05.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:30:05.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:30:05.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:05.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:05.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:30:05.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:30:05.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:30:05.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:30:05.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:30:05.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:05.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:05.032 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:30:05.033 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:30:05.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:30:05.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:30:05.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:30:05.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1241: test_get_not_primary: run_mon td/ceph-helpers a --osd_pool_default_size=2 2026-02-17T12:30:05.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:30:05.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:30:05.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:30:05.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:30:05.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:30:05.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2026-02-17T12:30:05.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:30:05.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:05.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:05.054 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:05.054 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:05.054 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:05.054 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:05.054 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T12:30:05.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:30:05.083 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:30:05.084 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:30:05.084 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:30:05.084 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:30:05.084 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:30:05.084 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:30:05.084 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:30:05.085 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:30:05.085 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:30:05.085 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:05.085 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:05.085 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:30:05.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:30:05.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:30:05.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:30:05.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:30:05.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:30:05.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:30:05.130 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:30:05.130 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:30:05.130 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:30:05.130 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:30:05.130 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:30:05.130 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:05.130 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:05.130 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:30:05.130 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:30:05.130 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:30:05.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1242: test_get_not_primary: run_mgr td/ceph-helpers x 2026-02-17T12:30:05.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:30:05.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:30:05.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:30:05.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:30:05.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:30:05.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:30:05.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:30:05.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:05.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:05.271 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:05.271 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:05.272 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:05.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:05.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:30:05.272 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:30:05.292 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1243: test_get_not_primary: run_osd td/ceph-helpers 0 2026-02-17T12:30:05.292 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:30:05.292 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:30:05.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:30:05.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:30:05.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:30:05.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:30:05.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:30:05.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:30:05.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:30:05.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:30:05.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:30:05.295 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:30:05.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4af3aff7-9920-4dbe-ac46-1ef79c653b48 2026-02-17T12:30:05.296 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 4af3aff7-9920-4dbe-ac46-1ef79c653b48 2026-02-17T12:30:05.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 4af3aff7-9920-4dbe-ac46-1ef79c653b48' 2026-02-17T12:30:05.296 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:30:05.305 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBNX5RpPXsPEhAAahUmczM+OcOyJfEG0Or2wQ== 2026-02-17T12:30:05.305 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBNX5RpPXsPEhAAahUmczM+OcOyJfEG0Or2wQ=="}' 2026-02-17T12:30:05.305 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4af3aff7-9920-4dbe-ac46-1ef79c653b48 -i td/ceph-helpers/0/new.json 2026-02-17T12:30:05.408 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:30:05.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:30:05.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBNX5RpPXsPEhAAahUmczM+OcOyJfEG0Or2wQ== --osd-uuid 4af3aff7-9920-4dbe-ac46-1ef79c653b48 2026-02-17T12:30:05.434 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:05.432+0000 7f88e1413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:05.435 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:05.434+0000 7f88e1413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:05.436 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:05.435+0000 7f88e1413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:05.437 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:05.435+0000 7f88e1413780 -1 bdev(0x5580c26a3c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:30:05.437 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:05.435+0000 7f88e1413780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:30:08.103 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:30:08.103 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:30:08.104 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:30:08.104 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:30:08.104 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:30:08.359 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:30:08.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:30:08.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:30:08.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:30:08.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:30:08.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:30:08.375 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:08.373+0000 7f6312480780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:08.376 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:08.375+0000 7f6312480780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:08.377 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:08.376+0000 7f6312480780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:08.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:30:08.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:30:08.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:30:08.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:30:08.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:30:08.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:08.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:30:08.551 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:30:08.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:08.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:08.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:09.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:09.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:09.739 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:30:09.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:30:09.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:09.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:09.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:10.216 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:10.215+0000 7f6312480780 -1 Falling back to public interface 2026-02-17T12:30:10.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:10.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:10.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:30:10.930 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:30:10.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:10.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:11.118 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:12.119 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:12.119 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:12.120 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:30:12.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:30:12.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:12.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:12.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:13.159 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:13.157+0000 7f6312480780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:30:13.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:13.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:13.312 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:30:13.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:30:13.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:13.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:13.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:14.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:14.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:14.504 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:30:14.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:30:14.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:14.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:14.696 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4260807140,v1:127.0.0.1:6803/4260807140] [v2:127.0.0.1:6804/4260807140,v1:127.0.0.1:6805/4260807140] exists,up 4af3aff7-9920-4dbe-ac46-1ef79c653b48 2026-02-17T12:30:14.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:30:14.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:30:14.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:30:14.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1244: test_get_not_primary: run_osd td/ceph-helpers 1 2026-02-17T12:30:14.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:30:14.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/1 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:30:14.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:30:14.702 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:30:14.702 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:14.702 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:14.702 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:14.702 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:14.702 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:14.702 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:14.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:14.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:30:14.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:30:14.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:30:14.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:30:14.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:30:14.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:30:14.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:30:14.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:30:14.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:30:14.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:30:14.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:30:14.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/1 2026-02-17T12:30:14.704 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:30:14.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=3e23a430-59df-40e5-bbfb-3ab080a88c5a 2026-02-17T12:30:14.705 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 3e23a430-59df-40e5-bbfb-3ab080a88c5a' 2026-02-17T12:30:14.705 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 3e23a430-59df-40e5-bbfb-3ab080a88c5a 2026-02-17T12:30:14.706 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:30:14.712 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBWX5RpGQNSKhAAw9WmzZLJ3gHPvBzN4lJglQ== 2026-02-17T12:30:14.712 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBWX5RpGQNSKhAAw9WmzZLJ3gHPvBzN4lJglQ=="}' 2026-02-17T12:30:14.713 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 3e23a430-59df-40e5-bbfb-3ab080a88c5a -i td/ceph-helpers/1/new.json 2026-02-17T12:30:14.906 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:30:14.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/1/new.json 2026-02-17T12:30:14.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBWX5RpGQNSKhAAw9WmzZLJ3gHPvBzN4lJglQ== --osd-uuid 3e23a430-59df-40e5-bbfb-3ab080a88c5a 2026-02-17T12:30:14.932 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:14.929+0000 7fba28c80780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:14.933 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:14.931+0000 7fba28c80780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:14.934 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:14.932+0000 7fba28c80780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:14.934 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:14.932+0000 7fba28c80780 -1 bdev(0x560a6ec2bc00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:30:14.934 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:14.932+0000 7fba28c80780 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-17T12:30:17.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-17T12:30:17.304 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:30:17.305 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:30:17.305 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:30:17.305 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:30:17.559 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:30:17.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:30:17.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:30:17.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:30:17.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:30:17.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:30:17.576 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:17.574+0000 7f3a4be12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:17.577 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:17.575+0000 7f3a4be12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:17.578 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:17.576+0000 7f3a4be12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:17.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:30:17.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:30:17.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:30:17.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:30:17.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:30:17.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:17.751 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:30:17.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:30:17.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:17.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:30:17.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:18.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:18.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:18.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:30:18.941 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:30:18.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:18.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:30:19.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:19.179 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:19.176+0000 7f3a4be12780 -1 Falling back to public interface 2026-02-17T12:30:20.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:20.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:20.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:30:20.137 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:30:20.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:20.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:30:20.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:21.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:21.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:21.327 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:30:21.328 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:30:21.328 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:21.328 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:30:21.518 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:21.872 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:21.869+0000 7f3a4be12780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:30:22.519 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:22.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:22.520 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:30:22.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:30:22.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:22.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:30:22.711 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1330461983,v1:127.0.0.1:6811/1330461983] [v2:127.0.0.1:6812/1330461983,v1:127.0.0.1:6813/1330461983] exists,up 3e23a430-59df-40e5-bbfb-3ab080a88c5a 2026-02-17T12:30:22.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:30:22.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:30:22.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:30:22.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1245: test_get_not_primary: create_rbd_pool 2026-02-17T12:30:22.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:30:22.896 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:30:22.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:30:22.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:30:23.123 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:30:23.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:30:24.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:30:24.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1246: test_get_not_primary: wait_for_clean 2026-02-17T12:30:24.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:30:24.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:30:24.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:30:24.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:30:24.417 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:30:24.417 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:30:24.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:30:24.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:30:24.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:30:24.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:30:24.498 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:30:24.498 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:30:24.498 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:30:24.498 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:30:24.498 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:30:24.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:30:24.692 INFO:tasks.workunit.client.0.trial155.stderr:1' 2026-02-17T12:30:24.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:30:24.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:30:24.693 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:30:24.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836485 2026-02-17T12:30:24.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836485 2026-02-17T12:30:24.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T12:30:24.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:30:24.754 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:30:24.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672963 2026-02-17T12:30:24.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672963 2026-02-17T12:30:24.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836485 1-42949672963' 2026-02-17T12:30:24.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:30:24.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836485 2026-02-17T12:30:24.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:30:24.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:30:24.821 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836485 2026-02-17T12:30:24.821 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:30:24.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836485 2026-02-17T12:30:24.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T12:30:24.822 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836485 2026-02-17T12:30:24.822 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:30:25.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-17T12:30:25.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:30:26.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:30:26.012 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:30:26.203 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T12:30:26.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:30:26.204 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672963 2026-02-17T12:30:26.204 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:30:26.205 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:30:26.206 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672963 2026-02-17T12:30:26.206 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:30:26.207 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672963 2026-02-17T12:30:26.207 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2026-02-17T12:30:26.207 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 42949672963 2026-02-17T12:30:26.208 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:30:26.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672963 -lt 42949672963 2026-02-17T12:30:26.404 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:30:26.404 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:30:26.404 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:30:26.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:30:26.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:30:26.659 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:30:26.659 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:30:26.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:30:26.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:30:26.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:30:26.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:30:26.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:30:26.846 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:30:26.847 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:30:26.847 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:30:27.104 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:30:27.104 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:30:27.104 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:30:27.104 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1247: test_get_not_primary: get_primary rbd GROUP 2026-02-17T12:30:27.105 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=rbd 2026-02-17T12:30:27.105 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=GROUP 2026-02-17T12:30:27.105 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map rbd GROUP 2026-02-17T12:30:27.105 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2026-02-17T12:30:27.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1247: test_get_not_primary: local primary=1 2026-02-17T12:30:27.296 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: test_get_not_primary: get_not_primary rbd GROUP 2026-02-17T12:30:27.296 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1229: get_not_primary: local poolname=rbd 2026-02-17T12:30:27.296 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1230: get_not_primary: local objectname=GROUP 2026-02-17T12:30:27.296 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: get_primary rbd GROUP 2026-02-17T12:30:27.296 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=rbd 2026-02-17T12:30:27.296 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=GROUP 2026-02-17T12:30:27.296 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map rbd GROUP 2026-02-17T12:30:27.296 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2026-02-17T12:30:27.490 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1232: get_not_primary: local primary=1 2026-02-17T12:30:27.490 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: get_not_primary: ceph --format json osd map rbd GROUP 2026-02-17T12:30:27.490 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T12:30:27.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: test_get_not_primary: local not_primary=0 2026-02-17T12:30:27.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: test_get_not_primary: test 0 '!=' 1 2026-02-17T12:30:27.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: test_get_not_primary: test 0 = 0 -o 0 = 1 2026-02-17T12:30:27.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: test_get_not_primary: teardown td/ceph-helpers 2026-02-17T12:30:27.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:30:27.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:30:27.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:30:27.683 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:30:27.684 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:30:27.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:30:27.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:30:27.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:30:27.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:30:27.790 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:30:27.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:30:27.791 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:30:27.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:30:27.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:30:27.792 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:30:27.793 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:27.793 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:30:27.793 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:30:27.794 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:27.795 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:30:27.795 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:30:27.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:30:27.800 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:30:27.800 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:27.800 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:27.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_num_active_clean td/ceph-helpers 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1372: test_get_num_active_clean: local dir=td/ceph-helpers 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1374: test_get_num_active_clean: setup td/ceph-helpers 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:30:27.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:30:27.803 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:30:27.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:30:27.804 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:30:27.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:30:27.805 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:30:27.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:30:27.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:30:27.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:30:27.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:27.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:30:27.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:30:27.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:27.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:30:27.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:30:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:30:27.811 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:30:27.811 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:27.811 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:27.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:30:27.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:30:27.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:30:27.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:30:27.813 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:30:27.813 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:27.813 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:27.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:30:27.815 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:30:27.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:30:27.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:30:27.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:30:27.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1375: test_get_num_active_clean: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:30:27.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:30:27.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:30:27.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:30:27.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:30:27.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:30:27.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:30:27.834 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:30:27.834 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:27.834 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:27.835 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:27.835 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:27.835 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:27.835 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:27.835 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:30:27.860 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:30:27.862 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:30:27.862 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:30:27.862 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:30:27.863 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:30:27.863 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:30:27.863 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:30:27.864 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:30:27.864 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:30:27.864 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:30:27.864 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:27.864 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:27.864 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:30:27.864 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:30:27.864 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:30:27.907 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:30:27.907 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:30:27.907 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:30:27.907 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:30:27.907 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:30:27.907 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:30:27.908 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:30:27.908 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:30:27.908 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:30:27.908 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:27.908 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:27.908 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:30:27.908 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:30:27.908 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:30:27.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1376: test_get_num_active_clean: run_mgr td/ceph-helpers x 2026-02-17T12:30:27.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:30:27.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:30:27.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:30:27.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:30:27.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:30:27.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:30:28.048 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:30:28.049 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:28.049 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:28.049 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:28.049 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:28.049 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:28.050 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:28.050 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:30:28.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:30:28.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1377: test_get_num_active_clean: run_osd td/ceph-helpers 0 2026-02-17T12:30:28.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:30:28.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:30:28.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:30:28.072 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:30:28.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:30:28.074 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:30:28.074 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:30:28.074 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:30:28.074 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:30:28.074 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:30:28.074 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:30:28.074 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:30:28.074 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6fca8bfb-0de6-4959-a215-920dc35db50f 2026-02-17T12:30:28.074 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 6fca8bfb-0de6-4959-a215-920dc35db50f 2026-02-17T12:30:28.075 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 6fca8bfb-0de6-4959-a215-920dc35db50f' 2026-02-17T12:30:28.075 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:30:28.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBkX5RpM2rjBBAAh+6bfWpzO+n4kPbmyOdwxA== 2026-02-17T12:30:28.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBkX5RpM2rjBBAAh+6bfWpzO+n4kPbmyOdwxA=="}' 2026-02-17T12:30:28.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6fca8bfb-0de6-4959-a215-920dc35db50f -i td/ceph-helpers/0/new.json 2026-02-17T12:30:28.187 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:30:28.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:30:28.195 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBkX5RpM2rjBBAAh+6bfWpzO+n4kPbmyOdwxA== --osd-uuid 6fca8bfb-0de6-4959-a215-920dc35db50f 2026-02-17T12:30:28.213 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:28.210+0000 7fd497f3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:28.214 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:28.211+0000 7fd497f3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:28.215 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:28.212+0000 7fd497f3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:28.215 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:28.212+0000 7fd497f3f780 -1 bdev(0x55643d0c9c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:30:28.216 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:28.213+0000 7fd497f3f780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:30:31.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:30:31.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:30:31.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:30:31.098 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:30:31.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:30:31.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:30:31.351 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:30:31.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:30:31.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:30:31.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:30:31.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:30:31.366 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:31.364+0000 7ffa4fe10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:31.368 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:31.366+0000 7ffa4fe10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:31.369 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:31.366+0000 7ffa4fe10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:31.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:30:31.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:30:31.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:30:31.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:30:31.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:30:31.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:31.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:30:31.544 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:30:31.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:31.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:31.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:32.729 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:32.730 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:32.730 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:30:32.731 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:30:32.731 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:32.731 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:32.918 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:32.958 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:32.955+0000 7ffa4fe10780 -1 Falling back to public interface 2026-02-17T12:30:33.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:33.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:33.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:30:33.921 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:30:33.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:33.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:34.113 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:35.114 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:35.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:35.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:30:35.115 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:30:35.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:35.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:35.305 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:35.655 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:35.653+0000 7ffa4fe10780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:30:36.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:36.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:36.306 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:30:36.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:30:36.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:36.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:36.499 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/667529875,v1:127.0.0.1:6803/667529875] [v2:127.0.0.1:6804/667529875,v1:127.0.0.1:6805/667529875] exists,up 6fca8bfb-0de6-4959-a215-920dc35db50f 2026-02-17T12:30:36.500 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:30:36.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:30:36.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:30:36.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1378: test_get_num_active_clean: create_rbd_pool 2026-02-17T12:30:36.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:30:36.682 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:30:36.688 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:30:36.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:30:36.964 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:30:36.971 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:30:37.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:30:38.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1379: test_get_num_active_clean: wait_for_clean 2026-02-17T12:30:38.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:30:38.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:30:38.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:30:38.252 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:30:38.253 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:30:38.254 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:30:38.254 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:30:38.254 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:30:38.254 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:30:38.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:30:38.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:30:38.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:30:38.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:30:38.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:30:38.336 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:30:38.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:30:38.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:30:38.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:30:38.523 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:30:38.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836483 2026-02-17T12:30:38.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836483 2026-02-17T12:30:38.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T12:30:38.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:30:38.588 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836483 2026-02-17T12:30:38.588 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:30:38.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:30:38.589 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836483 2026-02-17T12:30:38.589 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:30:38.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836483 2026-02-17T12:30:38.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T12:30:38.590 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836483 2026-02-17T12:30:38.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:30:38.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:30:38.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:30:39.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:30:39.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:30:39.969 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:30:39.969 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:30:40.971 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:30:40.971 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:30:41.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T12:30:41.158 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:30:41.158 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:30:41.159 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:30:41.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:30:41.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:30:41.415 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:30:41.415 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:30:41.415 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:30:41.415 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:30:41.415 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:30:41.415 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:30:41.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:30:41.604 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:30:41.605 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:30:41.605 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:30:41.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:30:41.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:30:41.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:30:41.859 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1380: test_get_num_active_clean: get_num_active_clean 2026-02-17T12:30:41.859 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:30:41.859 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:30:41.859 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:30:41.859 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:30:41.859 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:30:42.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1380: test_get_num_active_clean: local num_active_clean=4 2026-02-17T12:30:42.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1381: test_get_num_active_clean: test 4 = 4 2026-02-17T12:30:42.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1382: test_get_num_active_clean: teardown td/ceph-helpers 2026-02-17T12:30:42.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:30:42.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:30:42.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:30:42.045 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:30:42.045 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:30:42.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:30:42.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:30:42.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:30:42.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:30:42.152 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:30:42.152 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:30:42.153 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:30:42.153 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:30:42.153 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:30:42.154 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:30:42.154 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:42.154 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:30:42.155 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:30:42.155 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:42.155 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:30:42.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:30:42.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:30:42.160 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:30:42.160 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:42.160 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:42.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:30:42.162 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:30:42.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:30:42.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:30:42.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_num_active_or_peered td/ceph-helpers 2026-02-17T12:30:42.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1402: test_get_num_active_or_peered: local dir=td/ceph-helpers 2026-02-17T12:30:42.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1404: test_get_num_active_or_peered: setup td/ceph-helpers 2026-02-17T12:30:42.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:30:42.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:30:42.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:30:42.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:30:42.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:30:42.163 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:30:42.164 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:30:42.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:30:42.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:30:42.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:30:42.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:30:42.165 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:30:42.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:30:42.165 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:30:42.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:30:42.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:30:42.166 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:30:42.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:42.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:30:42.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:30:42.167 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:42.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:30:42.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:30:42.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:30:42.170 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:30:42.170 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:42.171 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:42.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:30:42.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:30:42.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:30:42.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:30:42.172 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:30:42.173 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:42.173 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:42.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:30:42.174 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:30:42.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:30:42.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:30:42.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:30:42.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1405: test_get_num_active_or_peered: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:30:42.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:30:42.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:30:42.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:30:42.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:30:42.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:30:42.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:30:42.196 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:30:42.197 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:42.197 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:42.197 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:42.197 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:42.197 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:42.197 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:42.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:30:42.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:30:42.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:30:42.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:30:42.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:30:42.225 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:30:42.226 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:30:42.226 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:30:42.226 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:30:42.226 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:30:42.226 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:30:42.226 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:42.226 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:42.226 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:30:42.227 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:30:42.227 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:30:42.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:30:42.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:30:42.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:30:42.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:30:42.272 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:30:42.272 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:30:42.272 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:30:42.272 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:30:42.272 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:30:42.272 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:42.272 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:42.272 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:30:42.273 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:30:42.273 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:30:42.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1406: test_get_num_active_or_peered: run_mgr td/ceph-helpers x 2026-02-17T12:30:42.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:30:42.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:30:42.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:30:42.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:30:42.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:30:42.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:30:42.418 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:30:42.418 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:42.418 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:42.418 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:42.418 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:42.418 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:42.418 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:42.419 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:30:42.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:30:42.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1407: test_get_num_active_or_peered: run_osd td/ceph-helpers 0 2026-02-17T12:30:42.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:30:42.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:30:42.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:30:42.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:30:42.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:30:42.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:30:42.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:30:42.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:42.441 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:30:42.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:30:42.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:30:42.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:30:42.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4e73f540-df1d-4d0b-914f-c3e80e43a0ec 2026-02-17T12:30:42.443 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 4e73f540-df1d-4d0b-914f-c3e80e43a0ec 2026-02-17T12:30:42.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 4e73f540-df1d-4d0b-914f-c3e80e43a0ec' 2026-02-17T12:30:42.444 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:30:42.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQByX5RpQfHfGhAAAf/NcDJDGXDL192woVHWtQ== 2026-02-17T12:30:42.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQByX5RpQfHfGhAAAf/NcDJDGXDL192woVHWtQ=="}' 2026-02-17T12:30:42.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4e73f540-df1d-4d0b-914f-c3e80e43a0ec -i td/ceph-helpers/0/new.json 2026-02-17T12:30:42.556 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:30:42.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:30:42.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQByX5RpQfHfGhAAAf/NcDJDGXDL192woVHWtQ== --osd-uuid 4e73f540-df1d-4d0b-914f-c3e80e43a0ec 2026-02-17T12:30:42.580 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:42.578+0000 7f9cc0564780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:42.582 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:42.579+0000 7f9cc0564780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:42.583 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:42.580+0000 7f9cc0564780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:42.583 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:42.581+0000 7f9cc0564780 -1 bdev(0x55e2713ddc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:30:42.583 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:42.581+0000 7f9cc0564780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:30:45.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:30:45.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:30:45.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:30:45.237 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:30:45.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:30:45.502 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:30:45.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:30:45.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:30:45.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:30:45.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:30:45.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:30:45.518 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:45.516+0000 7f900ad8f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:45.520 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:45.517+0000 7f900ad8f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:45.521 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:45.518+0000 7f900ad8f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:45.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:30:45.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:30:45.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:30:45.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:30:45.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:30:45.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:45.692 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:30:45.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:30:45.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:45.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:45.875 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:46.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:46.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:46.877 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:30:46.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:30:46.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:46.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:47.068 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:47.109 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:47.106+0000 7f900ad8f780 -1 Falling back to public interface 2026-02-17T12:30:48.070 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:48.070 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:48.070 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:30:48.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:30:48.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:48.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:48.258 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:49.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:49.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:49.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:30:49.260 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:30:49.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:49.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:49.446 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:30:50.052 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:50.050+0000 7f900ad8f780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:30:50.447 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:30:50.447 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:30:50.448 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:30:50.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:30:50.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:30:50.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:30:50.641 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3525159047,v1:127.0.0.1:6803/3525159047] [v2:127.0.0.1:6804/3525159047,v1:127.0.0.1:6805/3525159047] exists,up 4e73f540-df1d-4d0b-914f-c3e80e43a0ec 2026-02-17T12:30:50.642 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:30:50.642 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:30:50.642 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:30:50.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1408: test_get_num_active_or_peered: create_rbd_pool 2026-02-17T12:30:50.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:30:50.826 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:30:50.833 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:30:50.833 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:30:51.074 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:30:51.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:30:52.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:30:52.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1409: test_get_num_active_or_peered: wait_for_clean 2026-02-17T12:30:52.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:30:52.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:30:52.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:30:52.365 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:30:52.366 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:30:52.366 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:30:52.366 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:30:52.366 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:30:52.366 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:30:52.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:30:52.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:30:52.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:30:52.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:30:52.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:30:52.452 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:30:52.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:30:52.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:30:52.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:30:52.650 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:30:52.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836484 2026-02-17T12:30:52.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836484 2026-02-17T12:30:52.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836484' 2026-02-17T12:30:52.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:30:52.711 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836484 2026-02-17T12:30:52.711 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:30:52.712 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:30:52.713 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836484 2026-02-17T12:30:52.713 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:30:52.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836484 2026-02-17T12:30:52.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-17T12:30:52.714 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836484 2026-02-17T12:30:52.714 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:30:52.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T12:30:52.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:30:53.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:30:53.902 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:30:54.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T12:30:54.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:30:55.096 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:30:55.097 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:30:55.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-17T12:30:55.295 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:30:55.295 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:30:55.296 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:30:55.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:30:55.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:30:55.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:30:55.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:30:55.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:30:55.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:30:55.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:30:55.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:30:55.731 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:30:55.732 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:30:55.732 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:30:55.732 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:30:55.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:30:55.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:30:55.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:30:55.985 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1410: test_get_num_active_or_peered: get_num_active_or_peered 2026-02-17T12:30:55.985 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1394: get_num_active_or_peered: local expression 2026-02-17T12:30:55.986 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1395: get_num_active_or_peered: expression+='select(contains("active") or contains("peered")) | ' 2026-02-17T12:30:55.986 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1396: get_num_active_or_peered: expression+='select(contains("stale") | not)' 2026-02-17T12:30:55.986 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1397: get_num_active_or_peered: ceph --format json pg dump pgs 2026-02-17T12:30:55.986 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1398: get_num_active_or_peered: jq '.pg_stats | [.[] | .state | select(contains("active") or contains("peered")) | select(contains("stale") | not)] | length' 2026-02-17T12:30:56.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1410: test_get_num_active_or_peered: local num_peered=4 2026-02-17T12:30:56.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1411: test_get_num_active_or_peered: test 4 = 4 2026-02-17T12:30:56.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1412: test_get_num_active_or_peered: teardown td/ceph-helpers 2026-02-17T12:30:56.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:30:56.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:30:56.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:30:56.172 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:30:56.172 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:30:56.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:30:56.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:30:56.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:30:56.277 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:30:56.278 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:30:56.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:30:56.279 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:30:56.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:30:56.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:30:56.281 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:30:56.282 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:56.282 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:30:56.282 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:30:56.283 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:56.283 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:30:56.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:30:56.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:30:56.288 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:30:56.288 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:56.288 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:56.288 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:30:56.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:30:56.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:30:56.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:30:56.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_num_pgs td/ceph-helpers 2026-02-17T12:30:56.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1429: test_get_num_pgs: local dir=td/ceph-helpers 2026-02-17T12:30:56.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1431: test_get_num_pgs: setup td/ceph-helpers 2026-02-17T12:30:56.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:30:56.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:30:56.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:30:56.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:30:56.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:30:56.291 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:30:56.291 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:30:56.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:30:56.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:30:56.291 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:30:56.292 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:30:56.292 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:30:56.292 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:30:56.293 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:30:56.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:30:56.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:30:56.294 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:30:56.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:56.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:30:56.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:30:56.295 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:30:56.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:30:56.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:30:56.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:30:56.298 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:30:56.298 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:56.298 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:56.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:30:56.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:30:56.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:30:56.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:30:56.300 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:30:56.300 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:56.300 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:56.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:30:56.301 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:30:56.302 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:30:56.302 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:30:56.302 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:30:56.302 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1432: test_get_num_pgs: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:30:56.302 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:30:56.302 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:30:56.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:30:56.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:30:56.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:30:56.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:30:56.322 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:30:56.322 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:56.322 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:56.323 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:56.323 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:56.323 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:56.323 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:56.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:30:56.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:30:56.350 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:30:56.350 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:30:56.350 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:30:56.351 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:30:56.351 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:30:56.351 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:30:56.351 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:30:56.351 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:30:56.352 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:30:56.352 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:56.352 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:56.352 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:30:56.352 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:30:56.352 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:30:56.395 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:30:56.396 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:30:56.396 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:30:56.396 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:30:56.396 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:30:56.396 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:30:56.396 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:30:56.396 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:30:56.397 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:30:56.397 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:56.397 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:56.397 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:30:56.397 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:30:56.397 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:30:56.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1433: test_get_num_pgs: run_mgr td/ceph-helpers x 2026-02-17T12:30:56.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:30:56.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:30:56.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:30:56.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:30:56.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:30:56.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:30:56.539 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:30:56.539 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:56.539 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:56.540 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:56.540 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:56.540 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:56.540 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:56.540 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:30:56.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:30:56.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1434: test_get_num_pgs: run_osd td/ceph-helpers 0 2026-02-17T12:30:56.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:30:56.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:30:56.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:30:56.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:30:56.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:30:56.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:30:56.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:30:56.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:30:56.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:30:56.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:30:56.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:30:56.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:30:56.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:30:56.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:30:56.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:30:56.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:30:56.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:30:56.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:30:56.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:30:56.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:30:56.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:30:56.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:30:56.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:30:56.563 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:30:56.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=a95c6f9d-f711-413e-b63a-0292786b661e 2026-02-17T12:30:56.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 a95c6f9d-f711-413e-b63a-0292786b661e' 2026-02-17T12:30:56.564 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 a95c6f9d-f711-413e-b63a-0292786b661e 2026-02-17T12:30:56.565 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:30:56.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCAX5RpaIgVIhAArkFhCnHn+XjGGjhgg3SThQ== 2026-02-17T12:30:56.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCAX5RpaIgVIhAArkFhCnHn+XjGGjhgg3SThQ=="}' 2026-02-17T12:30:56.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new a95c6f9d-f711-413e-b63a-0292786b661e -i td/ceph-helpers/0/new.json 2026-02-17T12:30:56.676 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:30:56.682 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:30:56.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCAX5RpaIgVIhAArkFhCnHn+XjGGjhgg3SThQ== --osd-uuid a95c6f9d-f711-413e-b63a-0292786b661e 2026-02-17T12:30:56.701 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:56.700+0000 7f831f20c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:56.702 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:56.701+0000 7f831f20c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:56.703 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:56.702+0000 7f831f20c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:56.704 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:56.702+0000 7f831f20c780 -1 bdev(0x5620649abc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:30:56.704 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:56.702+0000 7f831f20c780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:30:59.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:30:59.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:30:59.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:30:59.606 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:30:59.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:30:59.859 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:30:59.860 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:30:59.860 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:30:59.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:30:59.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:30:59.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:30:59.880 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:59.879+0000 7fc3cb4e9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:59.882 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:59.880+0000 7fc3cb4e9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:30:59.883 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:30:59.881+0000 7fc3cb4e9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:00.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:31:00.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:31:00.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:31:00.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:31:00.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:31:00.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:00.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:31:00.052 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:31:00.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:00.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:00.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:01.220 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:01.218+0000 7fc3cb4e9780 -1 Falling back to public interface 2026-02-17T12:31:01.239 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:01.240 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:01.240 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:31:01.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:31:01.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:01.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:01.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:02.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:02.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:02.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:31:02.431 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:31:02.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:02.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:02.618 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:03.620 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:03.620 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:03.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:31:03.621 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:31:03.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:03.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:03.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:03.916 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:03.914+0000 7fc3cb4e9780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:31:04.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:04.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:04.811 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:31:04.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:31:04.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:04.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:05.002 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2290139147,v1:127.0.0.1:6803/2290139147] [v2:127.0.0.1:6804/2290139147,v1:127.0.0.1:6805/2290139147] exists,up a95c6f9d-f711-413e-b63a-0292786b661e 2026-02-17T12:31:05.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:31:05.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:31:05.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:31:05.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1435: test_get_num_pgs: create_rbd_pool 2026-02-17T12:31:05.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:31:05.185 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:31:05.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:31:05.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:31:05.428 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:31:05.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:31:06.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:31:06.718 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1436: test_get_num_pgs: wait_for_clean 2026-02-17T12:31:06.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:31:06.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:31:06.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:31:06.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:31:06.719 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:31:06.719 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:31:06.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:31:06.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:31:06.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:31:06.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:31:06.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:31:06.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:31:06.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:31:06.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:31:06.800 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:31:06.988 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:31:06.988 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:31:06.988 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:31:06.988 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:31:07.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836483 2026-02-17T12:31:07.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836483 2026-02-17T12:31:07.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T12:31:07.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:31:07.051 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836483 2026-02-17T12:31:07.051 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:31:07.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:31:07.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836483 2026-02-17T12:31:07.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:31:07.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836483 2026-02-17T12:31:07.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T12:31:07.054 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836483 2026-02-17T12:31:07.054 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:31:07.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:31:07.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:31:08.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:31:08.243 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:31:08.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:31:08.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:31:09.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:31:09.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:31:09.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T12:31:09.625 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:31:09.625 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:31:09.625 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:31:09.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:31:09.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:31:09.877 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:31:09.877 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:31:09.877 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:31:09.877 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:31:09.878 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:31:09.878 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:31:10.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:31:10.061 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:31:10.061 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:31:10.061 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:31:10.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:31:10.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:31:10.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:31:10.309 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1437: test_get_num_pgs: get_num_pgs 2026-02-17T12:31:10.309 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:31:10.310 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:31:10.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1437: test_get_num_pgs: local num_pgs=4 2026-02-17T12:31:10.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1438: test_get_num_pgs: test 4 -gt 0 2026-02-17T12:31:10.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1439: test_get_num_pgs: teardown td/ceph-helpers 2026-02-17T12:31:10.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:31:10.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:31:10.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:31:10.562 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:31:10.562 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:31:10.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:31:10.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:31:10.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:31:10.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:31:10.668 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:31:10.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:31:10.669 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:31:10.671 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:31:10.671 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:31:10.671 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:31:10.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:10.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:31:10.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:31:10.673 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:10.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:31:10.674 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:31:10.674 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:31:10.678 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:31:10.678 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:10.678 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:10.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:31:10.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:31:10.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_op_scheduler td/ceph-helpers 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2323: test_get_op_scheduler: local dir=td/ceph-helpers 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2325: test_get_op_scheduler: setup td/ceph-helpers 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:31:10.681 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:31:10.682 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:31:10.682 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:31:10.682 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:31:10.682 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:31:10.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:31:10.683 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:31:10.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:31:10.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:31:10.684 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:31:10.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:10.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:31:10.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:31:10.685 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:10.686 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:31:10.686 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:31:10.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:31:10.688 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:31:10.688 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:10.688 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:10.688 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:31:10.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:31:10.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:31:10.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:31:10.690 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:31:10.690 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:10.690 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:10.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:31:10.691 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:31:10.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:31:10.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:31:10.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:31:10.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: test_get_op_scheduler: run_mon td/ceph-helpers a 2026-02-17T12:31:10.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:31:10.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:31:10.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:31:10.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:31:10.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:31:10.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-17T12:31:10.713 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:31:10.713 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:31:10.713 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:31:10.713 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:31:10.713 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:10.713 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:10.713 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:10.713 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:31:10.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:31:10.740 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:31:10.741 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:31:10.741 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:31:10.741 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:31:10.741 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:31:10.741 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:31:10.741 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:31:10.741 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:31:10.741 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:31:10.741 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:10.741 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:10.742 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:31:10.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:31:10.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:31:10.786 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:31:10.786 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:31:10.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:31:10.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2328: test_get_op_scheduler: run_mgr td/ceph-helpers x 2026-02-17T12:31:10.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:31:10.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:31:10.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:31:10.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:31:10.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:31:10.832 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:31:10.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:31:10.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:31:10.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:31:10.932 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:31:10.932 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:10.932 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:10.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:10.933 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:31:10.933 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:31:10.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2330: test_get_op_scheduler: run_osd td/ceph-helpers 0 --osd_op_queue=wpq 2026-02-17T12:31:10.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:31:10.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:31:10.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:31:10.954 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:31:10.954 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:31:10.954 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:31:10.954 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:31:10.954 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:10.954 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:10.954 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:10.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:10.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:31:10.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_op_queue=wpq 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:31:10.955 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=d4b32b3d-fa99-4bff-affb-51309aff630f 2026-02-17T12:31:10.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 d4b32b3d-fa99-4bff-affb-51309aff630f' 2026-02-17T12:31:10.956 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 d4b32b3d-fa99-4bff-affb-51309aff630f 2026-02-17T12:31:10.956 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:31:10.964 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCOX5Rpf25eORAA7zXYyskYe0nmAhsKwJmZaQ== 2026-02-17T12:31:10.964 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCOX5Rpf25eORAA7zXYyskYe0nmAhsKwJmZaQ=="}' 2026-02-17T12:31:10.964 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new d4b32b3d-fa99-4bff-affb-51309aff630f -i td/ceph-helpers/0/new.json 2026-02-17T12:31:11.066 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:31:11.073 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:31:11.074 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=wpq --mkfs --key AQCOX5Rpf25eORAA7zXYyskYe0nmAhsKwJmZaQ== --osd-uuid d4b32b3d-fa99-4bff-affb-51309aff630f 2026-02-17T12:31:11.092 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:11.090+0000 7fe7e6e97780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:11.093 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:11.092+0000 7fe7e6e97780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:11.094 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:11.093+0000 7fe7e6e97780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:11.094 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:11.093+0000 7fe7e6e97780 -1 bdev(0x55c31f80dc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:31:11.095 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:11.093+0000 7fe7e6e97780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:31:13.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:31:13.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:31:13.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:31:13.985 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:31:13.986 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:31:14.241 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:31:14.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:31:14.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=wpq 2026-02-17T12:31:14.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:31:14.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:31:14.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:31:14.258 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:14.257+0000 7f10f062f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:14.260 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:14.258+0000 7f10f062f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:14.261 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:14.259+0000 7f10f062f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:14.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:31:14.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:31:14.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:31:14.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:31:14.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:31:14.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:14.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:31:14.433 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:31:14.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:14.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:14.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:15.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:15.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:15.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:31:15.624 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:31:15.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:15.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:15.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:15.850 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:15.848+0000 7f10f062f780 -1 Falling back to public interface 2026-02-17T12:31:16.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:16.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:16.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:31:16.816 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:31:16.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:16.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:17.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:18.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:18.005 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:31:18.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:18.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:31:18.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:18.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:18.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:18.554 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:18.552+0000 7f10f062f780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:31:19.198 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:19.198 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:19.199 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:31:19.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:31:19.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:19.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:19.386 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/470850565,v1:127.0.0.1:6803/470850565] [v2:127.0.0.1:6804/470850565,v1:127.0.0.1:6805/470850565] exists,up d4b32b3d-fa99-4bff-affb-51309aff630f 2026-02-17T12:31:19.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:31:19.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:31:19.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:31:19.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2331: test_get_op_scheduler: get_op_scheduler 0 2026-02-17T12:31:19.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: get_op_scheduler: local id=0 2026-02-17T12:31:19.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2319: get_op_scheduler: get_config osd 0 osd_op_queue 2026-02-17T12:31:19.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=osd 2026-02-17T12:31:19.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=0 2026-02-17T12:31:19.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=osd_op_queue 2026-02-17T12:31:19.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .osd_op_queue 2026-02-17T12:31:19.389 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path osd.0 2026-02-17T12:31:19.389 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:31:19.390 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:31:19.390 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:31:19.390 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:19.390 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:19.390 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.0.asok 2026-02-17T12:31:19.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:31:19.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-osd.0.asok config get osd_op_queue 2026-02-17T12:31:19.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2331: test_get_op_scheduler: test wpq = wpq 2026-02-17T12:31:19.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2333: test_get_op_scheduler: run_osd td/ceph-helpers 1 --osd_op_queue=mclock_scheduler 2026-02-17T12:31:19.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:31:19.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:31:19.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:31:19.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:31:19.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/1 2026-02-17T12:31:19.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:31:19.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:31:19.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:31:19.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:31:19.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-17T12:31:19.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-17T12:31:19.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:31:19.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:31:19.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:31:19.440 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:31:19.440 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:31:19.440 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:31:19.440 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:31:19.440 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:19.440 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:19.440 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:31:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_op_queue=mclock_scheduler 2026-02-17T12:31:19.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/1 2026-02-17T12:31:19.442 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:31:19.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2ab264b4-821c-43b1-9be5-ce34208d3bd6 2026-02-17T12:31:19.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 2ab264b4-821c-43b1-9be5-ce34208d3bd6' 2026-02-17T12:31:19.442 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 2ab264b4-821c-43b1-9be5-ce34208d3bd6 2026-02-17T12:31:19.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:31:19.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCXX5Rp8E3JGhAAkQgumJ8uvDZ2X9DWLgA9qA== 2026-02-17T12:31:19.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCXX5Rp8E3JGhAAkQgumJ8uvDZ2X9DWLgA9qA=="}' 2026-02-17T12:31:19.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2ab264b4-821c-43b1-9be5-ce34208d3bd6 -i td/ceph-helpers/1/new.json 2026-02-17T12:31:19.644 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:31:19.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/1/new.json 2026-02-17T12:31:19.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler --mkfs --key AQCXX5Rp8E3JGhAAkQgumJ8uvDZ2X9DWLgA9qA== --osd-uuid 2ab264b4-821c-43b1-9be5-ce34208d3bd6 2026-02-17T12:31:19.670 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:19.668+0000 7f6413afe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:19.671 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:19.669+0000 7f6413afe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:19.672 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:19.670+0000 7f6413afe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:19.672 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:19.671+0000 7f6413afe780 -1 bdev(0x559605201c00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:31:19.672 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:19.671+0000 7f6413afe780 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-17T12:31:21.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-17T12:31:21.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:31:21.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:31:21.785 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:31:21.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:31:22.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:31:22.052 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:31:22.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_op_queue=mclock_scheduler 2026-02-17T12:31:22.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:31:22.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:31:22.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:31:22.070 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:22.068+0000 7fef7621a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:22.071 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:22.070+0000 7fef7621a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:22.072 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:22.070+0000 7fef7621a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:22.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:31:22.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:31:22.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:31:22.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:31:22.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:31:22.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:22.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:31:22.242 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:31:22.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:22.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:31:22.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:23.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:23.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:23.431 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:31:23.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:31:23.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:23.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:31:23.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:23.660 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:23.658+0000 7fef7621a780 -1 Falling back to public interface 2026-02-17T12:31:24.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:24.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:24.624 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:31:24.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:31:24.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:24.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:31:24.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:25.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:25.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:25.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:31:25.815 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:31:25.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:25.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:31:26.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:26.603 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:26.601+0000 7fef7621a780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:31:27.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:27.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:27.008 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:31:27.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:31:27.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:27.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:31:27.199 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2428179293,v1:127.0.0.1:6811/2428179293] [v2:127.0.0.1:6812/2428179293,v1:127.0.0.1:6813/2428179293] exists,up 2ab264b4-821c-43b1-9be5-ce34208d3bd6 2026-02-17T12:31:27.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:31:27.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:31:27.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:31:27.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2334: test_get_op_scheduler: get_op_scheduler 1 2026-02-17T12:31:27.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: get_op_scheduler: local id=1 2026-02-17T12:31:27.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2319: get_op_scheduler: get_config osd 1 osd_op_queue 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=osd 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=1 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=osd_op_queue 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .osd_op_queue 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path osd.1 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.1.asok 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:31:27.202 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-osd.1.asok config get osd_op_queue 2026-02-17T12:31:27.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2334: test_get_op_scheduler: test mclock_scheduler = mclock_scheduler 2026-02-17T12:31:27.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2335: test_get_op_scheduler: teardown td/ceph-helpers 2026-02-17T12:31:27.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:31:27.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:31:27.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:31:27.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:31:27.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:31:27.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:31:27.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:31:27.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:31:27.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:31:27.357 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:31:27.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:31:27.358 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:31:27.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:31:27.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:31:27.360 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:31:27.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:27.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:31:27.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:31:27.362 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:27.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:31:27.363 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:31:27.363 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:31:27.368 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:31:27.368 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:27.368 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:27.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:31:27.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:31:27.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:31:27.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:31:27.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_osd_id_used_by_pgs td/ceph-helpers 2026-02-17T12:31:27.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1459: test_get_osd_id_used_by_pgs: local dir=td/ceph-helpers 2026-02-17T12:31:27.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1461: test_get_osd_id_used_by_pgs: setup td/ceph-helpers 2026-02-17T12:31:27.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:31:27.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:31:27.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:31:27.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:31:27.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:31:27.371 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:31:27.371 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:31:27.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:31:27.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:31:27.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:31:27.372 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:31:27.372 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:31:27.372 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:31:27.372 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:31:27.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:31:27.373 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:31:27.373 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:31:27.374 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:27.374 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:31:27.374 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:31:27.375 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:27.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:31:27.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:31:27.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:31:27.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:31:27.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:27.378 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:27.378 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:31:27.378 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:31:27.378 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:31:27.378 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:31:27.379 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:31:27.380 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:27.380 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:27.380 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:31:27.381 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:31:27.381 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:31:27.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:31:27.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:31:27.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: test_get_osd_id_used_by_pgs: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:31:27.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:31:27.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:31:27.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:31:27.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:31:27.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:31:27.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:31:27.403 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:31:27.403 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:31:27.403 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:31:27.403 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:31:27.403 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:27.403 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:27.403 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:27.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:31:27.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:31:27.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:31:27.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:31:27.432 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:31:27.432 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:31:27.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:31:27.433 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:31:27.433 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:31:27.433 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:31:27.433 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:31:27.433 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:27.434 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:27.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:31:27.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:31:27.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:31:27.479 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:31:27.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:31:27.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:31:27.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:31:27.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:31:27.480 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:31:27.480 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:31:27.480 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:31:27.480 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:31:27.480 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:27.480 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:27.481 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:31:27.481 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:31:27.481 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:31:27.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: test_get_osd_id_used_by_pgs: run_mgr td/ceph-helpers x 2026-02-17T12:31:27.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:31:27.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:31:27.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:31:27.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:31:27.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:31:27.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:31:27.627 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:31:27.627 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:31:27.627 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:31:27.628 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:31:27.628 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:27.628 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:27.628 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:27.628 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:31:27.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:31:27.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: test_get_osd_id_used_by_pgs: run_osd td/ceph-helpers 0 2026-02-17T12:31:27.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:31:27.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:31:27.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:31:27.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:31:27.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:31:27.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:31:27.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:31:27.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:31:27.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:31:27.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:31:27.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:31:27.652 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:31:27.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=fd6b187b-ba60-4497-84ca-500a611bf25a 2026-02-17T12:31:27.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 fd6b187b-ba60-4497-84ca-500a611bf25a' 2026-02-17T12:31:27.653 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 fd6b187b-ba60-4497-84ca-500a611bf25a 2026-02-17T12:31:27.653 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:31:27.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCfX5Rpo8RLJxAAkztn70rxlENIOnZV+23PAg== 2026-02-17T12:31:27.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCfX5Rpo8RLJxAAkztn70rxlENIOnZV+23PAg=="}' 2026-02-17T12:31:27.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new fd6b187b-ba60-4497-84ca-500a611bf25a -i td/ceph-helpers/0/new.json 2026-02-17T12:31:27.762 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:31:27.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:31:27.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCfX5Rpo8RLJxAAkztn70rxlENIOnZV+23PAg== --osd-uuid fd6b187b-ba60-4497-84ca-500a611bf25a 2026-02-17T12:31:27.787 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:27.786+0000 7f49b173b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:27.789 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:27.787+0000 7f49b173b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:27.789 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:27.788+0000 7f49b173b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:27.790 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:27.788+0000 7f49b173b780 -1 bdev(0x55f96c103c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:31:27.790 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:27.788+0000 7f49b173b780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:31:30.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:31:30.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:31:30.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:31:30.192 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:31:30.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:31:30.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:31:30.449 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:31:30.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:31:30.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:31:30.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:31:30.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:31:30.466 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:30.464+0000 7f099f195780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:30.467 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:30.466+0000 7f099f195780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:30.468 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:30.467+0000 7f099f195780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:30.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:31:30.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:31:30.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:31:30.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:31:30.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:31:30.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:30.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:31:30.637 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:31:30.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:30.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:30.826 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:31.826 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:31.826 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:31.827 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:31:31.827 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:31:31.827 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:31.827 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:32.016 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:32.064 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:32.062+0000 7f099f195780 -1 Falling back to public interface 2026-02-17T12:31:33.017 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:33.018 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:33.018 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:31:33.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:31:33.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:33.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:33.209 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:34.210 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:34.211 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:34.211 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:31:34.212 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:31:34.212 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:34.213 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:34.399 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:35.017 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:35.015+0000 7f099f195780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:31:35.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:35.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:35.401 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:31:35.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:31:35.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:35.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:35.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:36.593 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:36.593 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:36.593 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:31:36.594 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:31:36.594 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:36.594 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:36.783 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/191229531,v1:127.0.0.1:6803/191229531] [v2:127.0.0.1:6804/191229531,v1:127.0.0.1:6805/191229531] exists,up fd6b187b-ba60-4497-84ca-500a611bf25a 2026-02-17T12:31:36.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:31:36.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:31:36.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:31:36.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: test_get_osd_id_used_by_pgs: create_rbd_pool 2026-02-17T12:31:36.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:31:36.966 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:31:36.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:31:36.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:31:37.211 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:31:37.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:31:38.219 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:31:38.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: test_get_osd_id_used_by_pgs: wait_for_clean 2026-02-17T12:31:38.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:31:38.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:31:38.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:31:38.503 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:31:38.504 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:31:38.504 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:31:38.504 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:31:38.504 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:31:38.504 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:31:38.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:31:38.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:31:38.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:31:38.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:31:38.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:31:38.587 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:31:38.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:31:38.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:31:38.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:31:38.774 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:31:38.836 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836483 2026-02-17T12:31:38.836 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836483 2026-02-17T12:31:38.836 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T12:31:38.836 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:31:38.837 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836483 2026-02-17T12:31:38.837 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:31:38.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:31:38.838 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836483 2026-02-17T12:31:38.838 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:31:38.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836483 2026-02-17T12:31:38.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T12:31:38.839 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836483 2026-02-17T12:31:38.839 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:31:39.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:31:39.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:31:40.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:31:40.035 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:31:40.233 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T12:31:40.233 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:31:40.234 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:31:40.234 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:31:40.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:31:40.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:31:40.497 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:31:40.497 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:31:40.497 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:31:40.497 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:31:40.497 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:31:40.497 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:31:40.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:31:40.688 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:31:40.688 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:31:40.688 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:31:40.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:31:40.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:31:40.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:31:40.941 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: test_get_osd_id_used_by_pgs: get_osd_id_used_by_pgs 2026-02-17T12:31:40.941 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: test_get_osd_id_used_by_pgs: uniq 2026-02-17T12:31:40.941 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1455: get_osd_id_used_by_pgs: ceph --format json pg dump pgs 2026-02-17T12:31:40.942 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1455: get_osd_id_used_by_pgs: jq '.pg_stats | .[] | .up[], .acting[]' 2026-02-17T12:31:40.942 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1455: get_osd_id_used_by_pgs: sort 2026-02-17T12:31:41.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: test_get_osd_id_used_by_pgs: local osd_ids=0 2026-02-17T12:31:41.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1468: test_get_osd_id_used_by_pgs: test 0 = 0 2026-02-17T12:31:41.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1469: test_get_osd_id_used_by_pgs: teardown td/ceph-helpers 2026-02-17T12:31:41.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:31:41.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:31:41.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:31:41.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:31:41.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:31:41.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:31:41.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:31:41.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:31:41.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:31:41.236 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:31:41.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:31:41.237 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:31:41.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:31:41.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:31:41.239 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:31:41.240 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:41.240 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:31:41.240 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:31:41.240 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:41.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:31:41.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:31:41.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:31:41.246 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:31:41.246 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:41.246 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:41.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:31:41.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:31:41.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:31:41.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_osds td/ceph-helpers 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: test_get_osds: local dir=td/ceph-helpers 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1033: test_get_osds: setup td/ceph-helpers 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:31:41.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:31:41.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:31:41.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:31:41.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:31:41.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:31:41.251 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:31:41.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:31:41.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:31:41.252 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:31:41.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:41.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:31:41.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:31:41.253 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:31:41.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:31:41.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:31:41.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:31:41.256 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:31:41.256 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:41.256 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:41.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:31:41.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:31:41.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:31:41.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:31:41.258 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:31:41.258 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:41.258 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:41.258 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:31:41.260 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:31:41.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:31:41.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:31:41.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:31:41.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: test_get_osds: run_mon td/ceph-helpers a --osd_pool_default_size=2 2026-02-17T12:31:41.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:31:41.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:31:41.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:31:41.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:31:41.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:31:41.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2026-02-17T12:31:41.280 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:31:41.280 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:31:41.280 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:31:41.280 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:31:41.280 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:41.280 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:41.281 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:41.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T12:31:41.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:31:41.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:31:41.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:31:41.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:31:41.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:31:41.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:31:41.308 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:31:41.308 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:31:41.308 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:31:41.309 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:31:41.309 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:41.309 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:41.309 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:31:41.309 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:31:41.309 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:31:41.353 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:31:41.353 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:31:41.353 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:31:41.353 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:31:41.354 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:31:41.354 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:31:41.354 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:31:41.354 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:31:41.354 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:31:41.354 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:41.354 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:41.354 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:31:41.355 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:31:41.355 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:31:41.397 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1035: test_get_osds: run_mgr td/ceph-helpers x 2026-02-17T12:31:41.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:31:41.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:31:41.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:31:41.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:31:41.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:31:41.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:31:41.499 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:31:41.499 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:31:41.500 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:31:41.500 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:31:41.500 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:41.500 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:41.500 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:41.500 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:31:41.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:31:41.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1036: test_get_osds: run_osd td/ceph-helpers 0 2026-02-17T12:31:41.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:31:41.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:31:41.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:31:41.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:31:41.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:31:41.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:31:41.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:31:41.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:31:41.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:31:41.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:31:41.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:41.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:31:41.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=165dad83-5720-4593-b8e7-ef627c09ef8b 2026-02-17T12:31:41.524 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 165dad83-5720-4593-b8e7-ef627c09ef8b 2026-02-17T12:31:41.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 165dad83-5720-4593-b8e7-ef627c09ef8b' 2026-02-17T12:31:41.524 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:31:41.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCtX5RpaVKkHxAAIu90GJTcEw0ivo1HuX4mqg== 2026-02-17T12:31:41.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCtX5RpaVKkHxAAIu90GJTcEw0ivo1HuX4mqg=="}' 2026-02-17T12:31:41.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 165dad83-5720-4593-b8e7-ef627c09ef8b -i td/ceph-helpers/0/new.json 2026-02-17T12:31:41.634 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:31:41.640 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:31:41.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCtX5RpaVKkHxAAIu90GJTcEw0ivo1HuX4mqg== --osd-uuid 165dad83-5720-4593-b8e7-ef627c09ef8b 2026-02-17T12:31:41.659 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:41.658+0000 7f68237b4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:41.660 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:41.659+0000 7f68237b4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:41.661 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:41.660+0000 7f68237b4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:41.662 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:41.660+0000 7f68237b4780 -1 bdev(0x55cc614b1c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:31:41.662 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:41.660+0000 7f68237b4780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:31:44.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:31:44.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:31:44.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:31:44.313 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:31:44.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:31:44.571 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:31:44.571 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:31:44.571 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:31:44.571 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:31:44.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:31:44.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:31:44.588 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:44.586+0000 7f9695007780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:44.589 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:44.588+0000 7f9695007780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:44.590 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:44.589+0000 7f9695007780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:44.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:31:44.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:31:44.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:31:44.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:31:44.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:31:44.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:44.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:31:44.770 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:31:44.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:44.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:44.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:45.959 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:45.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:45.960 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:31:45.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:31:45.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:45.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:46.152 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:46.182 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:46.180+0000 7f9695007780 -1 Falling back to public interface 2026-02-17T12:31:47.152 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:47.153 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:47.153 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:31:47.153 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:31:47.153 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:47.153 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:47.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:48.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:48.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:48.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:31:48.348 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:31:48.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:48.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:48.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:49.141 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:49.139+0000 7f9695007780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:31:49.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:49.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:49.543 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:31:49.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:31:49.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:49.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:49.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:50.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:50.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:50.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:31:50.736 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:31:50.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:50.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:31:50.932 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/292959796,v1:127.0.0.1:6803/292959796] [v2:127.0.0.1:6804/292959796,v1:127.0.0.1:6805/292959796] exists,up 165dad83-5720-4593-b8e7-ef627c09ef8b 2026-02-17T12:31:50.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:31:50.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:31:50.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:31:50.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1037: test_get_osds: run_osd td/ceph-helpers 1 2026-02-17T12:31:50.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:31:50.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:31:50.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:31:50.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:31:50.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/1 2026-02-17T12:31:50.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:31:50.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:31:50.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:31:50.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:31:50.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-17T12:31:50.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-17T12:31:50.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:31:50.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:31:50.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:31:50.938 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:31:50.938 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:31:50.938 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:31:50.938 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:31:50.938 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:31:50.938 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:31:50.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:31:50.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:31:50.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/1 2026-02-17T12:31:50.940 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:31:50.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c1f1dd65-c74c-432a-8016-a6224f0bd590 2026-02-17T12:31:50.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 c1f1dd65-c74c-432a-8016-a6224f0bd590' 2026-02-17T12:31:50.940 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 c1f1dd65-c74c-432a-8016-a6224f0bd590 2026-02-17T12:31:50.941 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:31:50.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC2X5Rpcf54OBAAM25s/kJF1JJW0gJ9NFw8Qw== 2026-02-17T12:31:50.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC2X5Rpcf54OBAAM25s/kJF1JJW0gJ9NFw8Qw=="}' 2026-02-17T12:31:50.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c1f1dd65-c74c-432a-8016-a6224f0bd590 -i td/ceph-helpers/1/new.json 2026-02-17T12:31:51.143 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:31:51.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/1/new.json 2026-02-17T12:31:51.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC2X5Rpcf54OBAAM25s/kJF1JJW0gJ9NFw8Qw== --osd-uuid c1f1dd65-c74c-432a-8016-a6224f0bd590 2026-02-17T12:31:51.169 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:51.167+0000 7fd7688d9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:51.170 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:51.169+0000 7fd7688d9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:51.172 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:51.170+0000 7fd7688d9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:51.172 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:51.170+0000 7fd7688d9780 -1 bdev(0x55f30121fc00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:31:51.172 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:51.170+0000 7fd7688d9780 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-17T12:31:53.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-17T12:31:53.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:31:53.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:31:53.294 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:31:53.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:31:53.551 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:31:53.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:31:53.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:31:53.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:31:53.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:31:53.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:31:53.568 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:53.567+0000 7f59bbe3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:53.570 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:53.568+0000 7f59bbe3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:53.571 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:53.569+0000 7f59bbe3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:31:53.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:31:53.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:31:53.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:31:53.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:31:53.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:31:53.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:53.740 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:31:53.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:31:53.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:53.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:31:53.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:54.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:54.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:54.928 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:31:54.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:31:54.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:54.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:31:55.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:55.156 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:55.154+0000 7f59bbe3d780 -1 Falling back to public interface 2026-02-17T12:31:56.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:56.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:56.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:31:56.122 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:31:56.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:56.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:31:56.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:57.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:57.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:57.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:31:57.316 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:31:57.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:57.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:31:57.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:31:57.865 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:31:57.863+0000 7f59bbe3d780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:31:58.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:31:58.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:31:58.504 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:31:58.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:31:58.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:31:58.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:31:58.692 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/340897884,v1:127.0.0.1:6811/340897884] [v2:127.0.0.1:6812/340897884,v1:127.0.0.1:6813/340897884] exists,up c1f1dd65-c74c-432a-8016-a6224f0bd590 2026-02-17T12:31:58.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:31:58.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:31:58.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:31:58.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1038: test_get_osds: create_rbd_pool 2026-02-17T12:31:58.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:31:58.874 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:31:58.882 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:31:58.882 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:31:59.095 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:31:59.103 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:32:00.104 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:32:00.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1039: test_get_osds: wait_for_clean 2026-02-17T12:32:00.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:32:00.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:32:00.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:32:00.388 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:32:00.388 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:00.388 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:00.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:00.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:00.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:00.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:32:00.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:32:00.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:32:00.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:32:00.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:32:00.470 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:32:00.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:32:00.662 INFO:tasks.workunit.client.0.trial155.stderr:1' 2026-02-17T12:32:00.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:32:00.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:32:00.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:32:00.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836485 2026-02-17T12:32:00.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836485 2026-02-17T12:32:00.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T12:32:00.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:32:00.728 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:32:00.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672963 2026-02-17T12:32:00.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672963 2026-02-17T12:32:00.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836485 1-42949672963' 2026-02-17T12:32:00.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:32:00.790 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836485 2026-02-17T12:32:00.790 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:32:00.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:32:00.791 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836485 2026-02-17T12:32:00.791 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:32:00.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836485 2026-02-17T12:32:00.792 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T12:32:00.792 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836485 2026-02-17T12:32:00.792 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:32:00.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-17T12:32:00.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:32:01.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:32:01.986 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:32:02.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T12:32:02.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:32:02.180 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672963 2026-02-17T12:32:02.180 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:32:02.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:32:02.181 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672963 2026-02-17T12:32:02.182 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:32:02.182 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672963 2026-02-17T12:32:02.182 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2026-02-17T12:32:02.183 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 42949672963 2026-02-17T12:32:02.183 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:32:02.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672963 -lt 42949672963 2026-02-17T12:32:02.376 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:32:02.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:32:02.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:32:02.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:32:02.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:32:02.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:32:02.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:32:02.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:32:02.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:32:02.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:32:02.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:32:02.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:32:02.819 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:32:02.819 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:32:02.819 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:32:03.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:32:03.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:32:03.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:32:03.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1040: test_get_osds: create_rbd_pool 2026-02-17T12:32:03.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:32:03.285 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:32:03.292 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:32:03.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:32:03.488 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:32:03.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:32:04.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:32:04.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1041: test_get_osds: get_osds rbd GROUP 2026-02-17T12:32:04.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=rbd 2026-02-17T12:32:04.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=GROUP 2026-02-17T12:32:04.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1041: test_get_osds: grep --quiet '^[0-1] [0-1]$' 2026-02-17T12:32:04.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map rbd GROUP 2026-02-17T12:32:04.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T12:32:04.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=1 2026-02-17T12:32:04.972 INFO:tasks.workunit.client.0.trial155.stderr:0' 2026-02-17T12:32:04.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 1 0 2026-02-17T12:32:04.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1042: test_get_osds: teardown td/ceph-helpers 2026-02-17T12:32:04.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:32:04.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:32:04.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:32:04.974 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:32:04.974 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:32:04.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:32:04.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:32:04.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:32:05.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:32:05.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:32:05.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:32:05.081 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:32:05.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:32:05.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:32:05.083 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:32:05.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:05.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:32:05.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:32:05.084 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:05.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:32:05.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:32:05.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:32:05.092 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:32:05.092 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:05.092 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:05.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:32:05.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:32:05.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:32:05.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:32:05.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_pg td/ceph-helpers 2026-02-17T12:32:05.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1100: test_get_pg: local dir=td/ceph-helpers 2026-02-17T12:32:05.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1102: test_get_pg: setup td/ceph-helpers 2026-02-17T12:32:05.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:32:05.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:32:05.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:32:05.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:32:05.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:32:05.095 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:32:05.095 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:32:05.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:32:05.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:32:05.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:32:05.096 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:32:05.096 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:32:05.096 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:32:05.096 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:32:05.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:32:05.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:32:05.097 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:32:05.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:05.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:32:05.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:32:05.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:05.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:32:05.100 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:32:05.100 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:32:05.101 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:32:05.101 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:05.101 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:05.101 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:32:05.102 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:32:05.102 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:32:05.102 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:32:05.103 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:32:05.103 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:05.103 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:05.103 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:32:05.104 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:32:05.105 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:32:05.105 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:32:05.105 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:32:05.105 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1103: test_get_pg: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:05.105 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:32:05.105 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:32:05.105 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:32:05.105 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:32:05.105 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:32:05.105 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:05.126 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:32:05.126 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:05.126 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:05.126 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:05.126 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:05.126 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:05.127 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:05.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:05.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:32:05.153 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:32:05.153 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:32:05.153 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:32:05.153 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:32:05.153 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:32:05.153 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:32:05.153 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:32:05.153 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:32:05.154 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:32:05.154 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:05.154 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:05.154 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:32:05.155 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:32:05.155 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:32:05.199 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:32:05.199 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:32:05.199 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:32:05.199 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:32:05.199 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:32:05.199 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:32:05.199 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:32:05.199 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:32:05.199 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:32:05.199 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:05.200 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:05.200 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:32:05.200 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:32:05.200 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:32:05.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1104: test_get_pg: run_mgr td/ceph-helpers x 2026-02-17T12:32:05.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:32:05.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:32:05.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:32:05.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:32:05.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:32:05.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:32:05.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:32:05.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:05.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:05.346 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:05.346 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:05.346 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:05.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:05.347 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:32:05.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:32:05.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1105: test_get_pg: run_osd td/ceph-helpers 0 2026-02-17T12:32:05.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:32:05.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:32:05.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:32:05.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:32:05.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:32:05.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:32:05.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:32:05.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:32:05.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:32:05.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:32:05.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:32:05.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:32:05.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:32:05.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:32:05.368 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:32:05.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:32:05.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:32:05.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:32:05.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:32:05.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:32:05.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:32:05.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:32:05.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:32:05.370 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:32:05.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=03759af0-5895-4f81-bfd1-d2acb4a69e09 2026-02-17T12:32:05.371 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 03759af0-5895-4f81-bfd1-d2acb4a69e09 2026-02-17T12:32:05.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 03759af0-5895-4f81-bfd1-d2acb4a69e09' 2026-02-17T12:32:05.371 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:32:05.379 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDFX5RpYi6GFhAAb9tOqMV5WW1oyo4TEWS20w== 2026-02-17T12:32:05.379 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDFX5RpYi6GFhAAb9tOqMV5WW1oyo4TEWS20w=="}' 2026-02-17T12:32:05.380 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 03759af0-5895-4f81-bfd1-d2acb4a69e09 -i td/ceph-helpers/0/new.json 2026-02-17T12:32:05.482 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:32:05.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:32:05.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDFX5RpYi6GFhAAb9tOqMV5WW1oyo4TEWS20w== --osd-uuid 03759af0-5895-4f81-bfd1-d2acb4a69e09 2026-02-17T12:32:05.506 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:05.505+0000 7fe33100d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:05.508 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:05.507+0000 7fe33100d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:05.509 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:05.508+0000 7fe33100d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:05.509 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:05.508+0000 7fe33100d780 -1 bdev(0x564b5bf51c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:32:05.510 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:05.508+0000 7fe33100d780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:32:08.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:32:08.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:32:08.393 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:32:08.393 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:32:08.393 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:32:08.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:32:08.649 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:32:08.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:32:08.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:32:08.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:32:08.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:32:08.666 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:08.664+0000 7f3aaf184780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:08.667 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:08.666+0000 7f3aaf184780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:08.668 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:08.667+0000 7f3aaf184780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:08.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:32:08.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:32:08.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:32:08.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:32:08.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:32:08.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:08.839 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:32:08.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:32:08.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:08.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:09.032 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:10.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:10.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:10.034 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:32:10.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:32:10.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:10.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:10.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:10.253 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:10.251+0000 7f3aaf184780 -1 Falling back to public interface 2026-02-17T12:32:11.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:11.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:11.225 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:32:11.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:32:11.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:11.226 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:11.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:32:12.417 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:32:12.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:12.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:12.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:13.208 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:13.207+0000 7f3aaf184780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:32:13.609 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:13.609 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:13.610 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:32:13.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:32:13.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:13.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:13.803 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:14.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:14.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:14.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:32:14.804 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:32:14.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:14.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:14.999 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3245692957,v1:127.0.0.1:6803/3245692957] [v2:127.0.0.1:6804/3245692957,v1:127.0.0.1:6805/3245692957] exists,up 03759af0-5895-4f81-bfd1-d2acb4a69e09 2026-02-17T12:32:15.000 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:32:15.000 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:32:15.000 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:32:15.000 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: test_get_pg: create_rbd_pool 2026-02-17T12:32:15.000 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:32:15.183 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:32:15.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:32:15.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:32:15.429 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:32:15.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:32:16.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:32:16.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1107: test_get_pg: wait_for_clean 2026-02-17T12:32:16.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:32:16.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:32:16.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:32:16.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:32:16.720 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:16.720 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:16.720 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:16.721 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:16.721 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:16.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:32:16.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:32:16.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:32:16.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:32:16.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:32:16.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:32:16.988 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:32:16.988 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:32:16.988 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:32:16.988 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:32:17.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836483 2026-02-17T12:32:17.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836483 2026-02-17T12:32:17.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T12:32:17.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:32:17.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836483 2026-02-17T12:32:17.056 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:32:17.056 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:32:17.057 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836483 2026-02-17T12:32:17.057 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:32:17.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836483 2026-02-17T12:32:17.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T12:32:17.058 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836483 2026-02-17T12:32:17.058 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:32:17.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:32:17.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:32:18.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:32:18.248 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:32:18.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T12:32:18.438 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:32:18.438 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:32:18.438 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:32:18.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:32:18.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:32:18.693 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:32:18.693 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:32:18.693 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:32:18.693 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:32:18.693 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:32:18.693 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:32:18.885 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:32:18.885 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:32:18.885 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:32:18.886 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:32:19.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:32:19.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:32:19.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:32:19.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1108: test_get_pg: get_pg rbd GROUP 2026-02-17T12:32:19.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=rbd 2026-02-17T12:32:19.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=GROUP 2026-02-17T12:32:19.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1108: test_get_pg: grep --quiet '^[0-9]\.[0-9a-f][0-9a-f]*$' 2026-02-17T12:32:19.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map rbd GROUP 2026-02-17T12:32:19.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2026-02-17T12:32:19.328 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1109: test_get_pg: teardown td/ceph-helpers 2026-02-17T12:32:19.328 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:32:19.328 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:32:19.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:32:19.329 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:32:19.329 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:32:19.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:32:19.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:32:19.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:32:19.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:32:19.435 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:32:19.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:32:19.436 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:32:19.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:32:19.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:32:19.438 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:32:19.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:19.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:32:19.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:32:19.440 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:19.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:32:19.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:32:19.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:32:19.446 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:32:19.446 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:19.446 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:19.447 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:32:19.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:32:19.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:32:19.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:32:19.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_primary td/ceph-helpers 2026-02-17T12:32:19.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1204: test_get_primary: local dir=td/ceph-helpers 2026-02-17T12:32:19.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1206: test_get_primary: setup td/ceph-helpers 2026-02-17T12:32:19.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:32:19.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:32:19.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:32:19.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:32:19.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:32:19.452 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:32:19.452 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:32:19.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:32:19.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:32:19.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:32:19.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:32:19.453 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:32:19.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:32:19.453 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:32:19.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:32:19.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:32:19.457 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:32:19.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:19.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:32:19.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:32:19.458 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:19.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:32:19.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:32:19.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:32:19.458 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:32:19.458 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:19.458 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:19.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:32:19.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:32:19.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:32:19.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:32:19.461 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:32:19.461 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:19.461 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:19.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:32:19.462 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:32:19.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:32:19.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:32:19.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:32:19.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1207: test_get_primary: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:19.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:32:19.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:32:19.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:32:19.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:32:19.463 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:32:19.463 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:19.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:32:19.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:19.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:19.481 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:19.481 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:19.481 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:19.481 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:19.481 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:19.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:32:19.507 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:32:19.507 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:32:19.507 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:32:19.507 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:32:19.508 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:32:19.509 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:32:19.509 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:32:19.509 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:32:19.509 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:32:19.509 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:19.509 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:19.509 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:32:19.509 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:32:19.509 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:32:19.554 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:32:19.554 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:32:19.554 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:32:19.554 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:32:19.554 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:32:19.555 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:32:19.555 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:32:19.555 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:32:19.555 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:32:19.556 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:19.556 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:19.556 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:32:19.556 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:32:19.556 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:32:19.600 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1208: test_get_primary: local osd=0 2026-02-17T12:32:19.600 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1209: test_get_primary: run_mgr td/ceph-helpers x 2026-02-17T12:32:19.600 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:32:19.600 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:32:19.600 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:32:19.600 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:32:19.600 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:32:19.600 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:32:19.701 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:32:19.702 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:19.702 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:19.702 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:19.702 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:19.702 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:19.703 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:19.703 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:32:19.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:32:19.723 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1210: test_get_primary: run_osd td/ceph-helpers 0 2026-02-17T12:32:19.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:32:19.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:32:19.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:32:19.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:32:19.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:32:19.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:32:19.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:32:19.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:32:19.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:32:19.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:32:19.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:32:19.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:32:19.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:32:19.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:32:19.725 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:32:19.725 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:32:19.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:32:19.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:32:19.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:32:19.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:32:19.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:32:19.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:32:19.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=0af1b2a0-0b74-427c-a2d8-7f1fbc6d71a7 2026-02-17T12:32:19.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 0af1b2a0-0b74-427c-a2d8-7f1fbc6d71a7' 2026-02-17T12:32:19.727 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 0af1b2a0-0b74-427c-a2d8-7f1fbc6d71a7 2026-02-17T12:32:19.728 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:32:19.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDTX5RpCjeoKxAAqH1ik7jCZ8ryc3xtlhY4hA== 2026-02-17T12:32:19.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDTX5RpCjeoKxAAqH1ik7jCZ8ryc3xtlhY4hA=="}' 2026-02-17T12:32:19.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 0af1b2a0-0b74-427c-a2d8-7f1fbc6d71a7 -i td/ceph-helpers/0/new.json 2026-02-17T12:32:19.838 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:32:19.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:32:19.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDTX5RpCjeoKxAAqH1ik7jCZ8ryc3xtlhY4hA== --osd-uuid 0af1b2a0-0b74-427c-a2d8-7f1fbc6d71a7 2026-02-17T12:32:19.864 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:19.862+0000 7fe185ad5780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:19.865 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:19.864+0000 7fe185ad5780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:19.866 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:19.865+0000 7fe185ad5780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:19.867 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:19.865+0000 7fe185ad5780 -1 bdev(0x55f6e14b5c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:32:19.867 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:19.865+0000 7fe185ad5780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:32:22.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:32:22.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:32:22.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:32:22.269 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:32:22.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:32:22.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:32:22.526 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:32:22.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:32:22.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:32:22.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:32:22.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:32:22.543 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:22.542+0000 7fb99ec2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:22.544 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:22.543+0000 7fb99ec2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:22.545 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:22.544+0000 7fb99ec2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:22.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:32:22.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:32:22.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:32:22.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:32:22.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:32:22.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:22.717 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:32:22.717 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:32:22.717 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:22.718 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:22.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:23.887 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:23.886+0000 7fb99ec2c780 -1 Falling back to public interface 2026-02-17T12:32:23.905 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:23.905 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:23.905 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:32:23.905 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:32:23.905 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:23.905 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:24.097 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:25.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:25.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:25.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:32:25.099 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:32:25.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:25.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:25.292 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:26.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:26.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:26.293 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:32:26.294 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:32:26.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:26.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:26.483 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:26.595 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:26.594+0000 7fb99ec2c780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:32:27.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:27.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:27.485 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:32:27.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:32:27.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:27.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:27.678 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2000201753,v1:127.0.0.1:6803/2000201753] [v2:127.0.0.1:6804/2000201753,v1:127.0.0.1:6805/2000201753] exists,up 0af1b2a0-0b74-427c-a2d8-7f1fbc6d71a7 2026-02-17T12:32:27.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:32:27.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:32:27.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:32:27.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1211: test_get_primary: create_rbd_pool 2026-02-17T12:32:27.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:32:27.861 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:32:27.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:32:27.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:32:28.112 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:32:28.118 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:32:29.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:32:29.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1212: test_get_primary: wait_for_clean 2026-02-17T12:32:29.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:32:29.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:32:29.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:32:29.403 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:32:29.403 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:29.403 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:29.403 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:29.403 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:29.404 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:32:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:32:29.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:32:29.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:32:29.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:32:29.486 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:32:29.674 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:32:29.674 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:32:29.675 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:32:29.675 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:32:29.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836484 2026-02-17T12:32:29.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836484 2026-02-17T12:32:29.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836484' 2026-02-17T12:32:29.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:32:29.738 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836484 2026-02-17T12:32:29.738 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:32:29.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:32:29.739 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836484 2026-02-17T12:32:29.740 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:32:29.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836484 2026-02-17T12:32:29.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-17T12:32:29.741 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836484 2026-02-17T12:32:29.741 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:32:29.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T12:32:29.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:32:30.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:32:30.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:32:31.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T12:32:31.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:32:32.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:32:32.122 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:32:32.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-17T12:32:32.323 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:32:32.323 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:32:32.323 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:32:32.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:32:32.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:32:32.576 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:32:32.576 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:32:32.576 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:32:32.576 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:32:32.577 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:32:32.577 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:32:32.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:32:32.761 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:32:32.761 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:32:32.761 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:32:33.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:32:33.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:32:33.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:32:33.014 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1213: test_get_primary: get_primary rbd GROUP 2026-02-17T12:32:33.014 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=rbd 2026-02-17T12:32:33.014 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=GROUP 2026-02-17T12:32:33.014 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map rbd GROUP 2026-02-17T12:32:33.014 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2026-02-17T12:32:33.207 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1213: test_get_primary: test 0 = 0 2026-02-17T12:32:33.207 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1214: test_get_primary: teardown td/ceph-helpers 2026-02-17T12:32:33.208 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:32:33.208 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:32:33.208 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:32:33.208 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:32:33.208 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:32:33.208 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:32:33.208 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:32:33.208 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:32:33.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:32:33.316 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:32:33.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:32:33.317 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:32:33.318 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:32:33.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:32:33.319 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:32:33.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:33.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:32:33.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:32:33.321 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:33.321 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:32:33.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:32:33.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:32:33.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:32:33.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:33.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:33.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:32:33.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:32:33.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:32:33.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:32:33.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_get_timeout_delays td/ceph-helpers 2026-02-17T12:32:33.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1630: test_get_timeout_delays: get_timeout_delays 1 2026-02-17T12:32:33.328 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.328 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1630: test_get_timeout_delays: test '1 ' = '1 ' 2026-02-17T12:32:33.337 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1631: test_get_timeout_delays: get_timeout_delays 5 2026-02-17T12:32:33.338 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.338 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.338 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.338 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.338 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1631: test_get_timeout_delays: test '1 2 2 ' = '1 2 2 ' 2026-02-17T12:32:33.356 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1632: test_get_timeout_delays: get_timeout_delays 6 2026-02-17T12:32:33.357 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.357 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.357 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.357 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.357 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1632: test_get_timeout_delays: test '1 2 3 ' = '1 2 3 ' 2026-02-17T12:32:33.375 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: test_get_timeout_delays: get_timeout_delays 7 2026-02-17T12:32:33.376 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.376 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.376 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.376 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.376 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: test_get_timeout_delays: test '1 2 4 ' = '1 2 4 ' 2026-02-17T12:32:33.398 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: test_get_timeout_delays: get_timeout_delays 8 2026-02-17T12:32:33.399 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.399 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.399 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.399 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.399 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.423 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: test_get_timeout_delays: test '1 2 4 1 ' = '1 2 4 1 ' 2026-02-17T12:32:33.423 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: test_get_timeout_delays: get_timeout_delays 1 .1 2026-02-17T12:32:33.424 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.424 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.424 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.424 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.424 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: test_get_timeout_delays: test '0.1 0.2 0.4 0.3 ' = '0.1 0.2 0.4 0.3 ' 2026-02-17T12:32:33.448 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: test_get_timeout_delays: get_timeout_delays 1.5 .1 2026-02-17T12:32:33.449 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.449 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.449 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.449 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.449 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 ' = '0.1 0.2 0.4 0.8 ' 2026-02-17T12:32:33.479 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: test_get_timeout_delays: get_timeout_delays 5 .1 2026-02-17T12:32:33.479 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.479 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.479 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.479 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 1.9 ' = '0.1 0.2 0.4 0.8 1.6 1.9 ' 2026-02-17T12:32:33.515 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1638: test_get_timeout_delays: get_timeout_delays 6 .1 2026-02-17T12:32:33.515 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.515 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.516 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.516 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.516 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1638: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 2.9 ' = '0.1 0.2 0.4 0.8 1.6 2.9 ' 2026-02-17T12:32:33.552 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: test_get_timeout_delays: get_timeout_delays 6.3 .1 2026-02-17T12:32:33.552 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.553 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.553 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.553 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.553 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 ' = '0.1 0.2 0.4 0.8 1.6 3.2 ' 2026-02-17T12:32:33.590 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: test_get_timeout_delays: get_timeout_delays 20 .1 2026-02-17T12:32:33.590 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.590 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 6.4 7.3 ' = '0.1 0.2 0.4 0.8 1.6 3.2 6.4 7.3 ' 2026-02-17T12:32:33.640 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1641: test_get_timeout_delays: get_timeout_delays 300 .1 0 2026-02-17T12:32:33.640 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.640 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.640 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.640 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.640 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1641: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 6.4 12.8 25.6 51.2 102.4 95.3 ' = '0.1 0.2 0.4 0.8 1.6 3.2 6.4 12.8 25.6 51.2 102.4 95.3 ' 2026-02-17T12:32:33.714 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: test_get_timeout_delays: get_timeout_delays 300 .1 10 2026-02-17T12:32:33.715 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:33.715 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:33.715 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:33.716 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:33.716 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:33.944 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1642: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 6.4 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 7.3 ' = '0.1 0.2 0.4 0.8 1.6 3.2 6.4 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 7.3 ' 2026-02-17T12:32:33.944 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:32:33.944 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_is_clean td/ceph-helpers 2026-02-17T12:32:33.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1561: test_is_clean: local dir=td/ceph-helpers 2026-02-17T12:32:33.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1563: test_is_clean: setup td/ceph-helpers 2026-02-17T12:32:33.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:32:33.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:32:33.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:32:33.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:32:33.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:32:33.945 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:32:33.945 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:32:33.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:32:33.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:32:33.946 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:32:33.946 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:32:33.946 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:32:33.946 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:32:33.947 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:32:33.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:32:33.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:32:33.947 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:32:33.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:33.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:32:33.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:32:33.949 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:33.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:32:33.950 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:32:33.950 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:32:33.951 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:32:33.951 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:33.951 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:33.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:32:33.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:32:33.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:32:33.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:32:33.953 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:32:33.953 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:33.954 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:33.954 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:32:33.954 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:32:33.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:32:33.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:32:33.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:32:33.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1564: test_is_clean: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:33.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:32:33.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:32:33.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:32:33.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:32:33.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:32:33.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:33.975 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:32:33.975 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:33.975 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:33.975 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:33.975 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:33.975 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:33.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:33.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:34.002 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:32:34.004 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:32:34.004 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:32:34.004 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:32:34.004 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:32:34.004 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:32:34.005 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:32:34.005 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:32:34.005 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:32:34.005 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:32:34.005 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:34.005 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:34.005 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:32:34.005 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:32:34.005 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:32:34.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:32:34.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:32:34.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:32:34.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:32:34.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:32:34.054 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:32:34.054 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:32:34.054 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:32:34.054 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:32:34.054 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:34.055 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:34.055 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:32:34.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:32:34.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:32:34.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1565: test_is_clean: run_mgr td/ceph-helpers x 2026-02-17T12:32:34.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:32:34.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:32:34.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:32:34.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:32:34.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:32:34.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:32:34.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:32:34.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:34.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:34.201 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:34.201 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:34.201 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:34.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:34.202 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:32:34.202 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:32:34.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1566: test_is_clean: run_osd td/ceph-helpers 0 2026-02-17T12:32:34.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:32:34.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:32:34.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:32:34.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:32:34.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:32:34.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:32:34.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:34.223 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:32:34.224 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:32:34.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:32:34.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:32:34.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:32:34.225 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:32:34.225 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=88be7eda-62c6-43cb-bb11-63c174f3db70 2026-02-17T12:32:34.226 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 88be7eda-62c6-43cb-bb11-63c174f3db70 2026-02-17T12:32:34.226 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 88be7eda-62c6-43cb-bb11-63c174f3db70' 2026-02-17T12:32:34.226 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:32:34.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDiX5Rpks/uDRAAv4sQKm2RO+DiPVLDIqEk+Q== 2026-02-17T12:32:34.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDiX5Rpks/uDRAAv4sQKm2RO+DiPVLDIqEk+Q=="}' 2026-02-17T12:32:34.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 88be7eda-62c6-43cb-bb11-63c174f3db70 -i td/ceph-helpers/0/new.json 2026-02-17T12:32:34.337 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:32:34.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:32:34.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDiX5Rpks/uDRAAv4sQKm2RO+DiPVLDIqEk+Q== --osd-uuid 88be7eda-62c6-43cb-bb11-63c174f3db70 2026-02-17T12:32:34.363 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:34.361+0000 7f1bd9082780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:34.364 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:34.362+0000 7f1bd9082780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:34.364 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:34.363+0000 7f1bd9082780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:34.365 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:34.363+0000 7f1bd9082780 -1 bdev(0x5578f6ff3c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:32:34.365 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:34.364+0000 7f1bd9082780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:32:37.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:32:37.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:32:37.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:32:37.269 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:32:37.269 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:32:37.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:32:37.524 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:32:37.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:32:37.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:32:37.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:32:37.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:32:37.540 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:37.539+0000 7f8f12e2a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:37.542 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:37.540+0000 7f8f12e2a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:37.542 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:37.541+0000 7f8f12e2a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:37.718 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:32:37.718 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:32:37.718 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:32:37.718 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:32:37.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:32:37.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:37.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:32:37.719 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:32:37.720 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:37.720 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:37.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:38.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:38.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:38.912 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:32:38.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:32:38.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:38.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:39.101 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:39.142 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:39.141+0000 7f8f12e2a780 -1 Falling back to public interface 2026-02-17T12:32:40.102 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:40.102 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:40.103 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:32:40.103 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:32:40.104 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:40.104 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:40.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:41.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:41.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:41.297 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:32:41.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:32:41.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:41.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:41.494 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:42.081 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:42.080+0000 7f8f12e2a780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:32:42.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:42.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:42.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:32:42.497 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:32:42.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:42.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:42.697 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:43.699 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:43.699 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:43.699 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:32:43.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:32:43.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:43.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:43.887 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2063535496,v1:127.0.0.1:6803/2063535496] [v2:127.0.0.1:6804/2063535496,v1:127.0.0.1:6805/2063535496] exists,up 88be7eda-62c6-43cb-bb11-63c174f3db70 2026-02-17T12:32:43.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:32:43.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:32:43.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:32:43.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1567: test_is_clean: create_rbd_pool 2026-02-17T12:32:43.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:32:44.069 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:32:44.077 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:32:44.077 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:32:44.315 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:32:44.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:32:45.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:32:45.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1568: test_is_clean: wait_for_clean 2026-02-17T12:32:45.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:32:45.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:32:45.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:32:45.606 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:32:45.607 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:32:45.607 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:32:45.607 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:32:45.607 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:32:45.608 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:32:45.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:32:45.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:32:45.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:32:45.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:32:45.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:32:45.691 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:32:45.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:32:45.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:32:45.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:32:45.877 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:32:45.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836483 2026-02-17T12:32:45.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836483 2026-02-17T12:32:45.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T12:32:45.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:32:45.939 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836483 2026-02-17T12:32:45.939 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:32:45.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:32:45.940 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836483 2026-02-17T12:32:45.940 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:32:45.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836483 2026-02-17T12:32:45.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T12:32:45.941 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836483 2026-02-17T12:32:45.942 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:32:46.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:32:46.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:32:47.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:32:47.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:32:47.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T12:32:47.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:32:47.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:32:47.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:32:47.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:32:47.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:32:47.581 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:32:47.582 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:32:47.582 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:32:47.582 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:32:47.582 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:32:47.582 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:32:47.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:32:47.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:32:47.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:32:47.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:32:48.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:32:48.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:32:48.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:32:48.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1569: test_is_clean: is_clean 2026-02-17T12:32:48.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1555: is_clean: get_num_pgs 2026-02-17T12:32:48.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:32:48.024 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:32:48.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1555: is_clean: num_pgs=4 2026-02-17T12:32:48.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1556: is_clean: test 4 '!=' 0 2026-02-17T12:32:48.274 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1557: is_clean: get_num_active_clean 2026-02-17T12:32:48.274 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:32:48.274 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:32:48.274 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:32:48.274 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:32:48.274 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:32:48.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1557: is_clean: test 4 = 4 2026-02-17T12:32:48.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1570: test_is_clean: teardown td/ceph-helpers 2026-02-17T12:32:48.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:32:48.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:32:48.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:32:48.459 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:32:48.459 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:32:48.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:32:48.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:32:48.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:32:48.565 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:32:48.565 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:32:48.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:32:48.566 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:32:48.568 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:32:48.568 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:32:48.568 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:32:48.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:48.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:32:48.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:32:48.570 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:48.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:32:48.571 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:32:48.571 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:32:48.575 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:32:48.575 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:48.575 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:48.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:32:48.577 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:32:48.577 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:32:48.577 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:32:48.577 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_kill_daemon td/ceph-helpers 2026-02-17T12:32:48.577 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:275: test_kill_daemon: local dir=td/ceph-helpers 2026-02-17T12:32:48.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:276: test_kill_daemon: setup td/ceph-helpers 2026-02-17T12:32:48.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:32:48.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:32:48.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:32:48.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:32:48.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:32:48.578 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:32:48.578 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:32:48.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:32:48.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:32:48.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:32:48.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:32:48.579 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:32:48.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:32:48.580 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:32:48.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:32:48.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:32:48.581 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:32:48.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:48.582 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:32:48.582 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:32:48.582 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:32:48.583 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:32:48.583 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:32:48.584 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:32:48.585 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:32:48.585 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:48.585 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:48.585 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:32:48.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:32:48.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:32:48.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:32:48.587 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:32:48.587 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:48.587 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:48.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:32:48.588 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:32:48.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:32:48.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:32:48.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:32:48.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:277: test_kill_daemon: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:48.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:32:48.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:32:48.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:32:48.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:32:48.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:32:48.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:48.610 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:32:48.610 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:48.610 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:48.610 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:48.610 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:48.610 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:48.611 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:48.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:32:48.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:32:48.638 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:32:48.638 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:32:48.638 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:32:48.639 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:32:48.639 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:32:48.639 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:32:48.639 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:32:48.639 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:32:48.639 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:32:48.639 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:48.639 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:48.639 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:32:48.640 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:32:48.640 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:32:48.683 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:32:48.683 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:32:48.683 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:32:48.683 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:32:48.683 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:32:48.684 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:32:48.685 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:32:48.685 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:32:48.685 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:32:48.685 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:48.685 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:48.685 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:32:48.685 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:32:48.685 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:32:48.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:278: test_kill_daemon: run_mgr td/ceph-helpers x 2026-02-17T12:32:48.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:32:48.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:32:48.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:32:48.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:32:48.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:32:48.729 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:32:48.828 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:32:48.829 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:48.829 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:48.829 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:48.829 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:48.829 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:48.829 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:48.830 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:32:48.830 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:32:48.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:279: test_kill_daemon: run_osd td/ceph-helpers 0 2026-02-17T12:32:48.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:32:48.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:32:48.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:32:48.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:32:48.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:32:48.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:32:48.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:32:48.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:32:48.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:32:48.851 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:32:48.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:32:48.853 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:32:48.853 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=1537ae18-1101-4a21-bec0-bb4c40999527 2026-02-17T12:32:48.853 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 1537ae18-1101-4a21-bec0-bb4c40999527 2026-02-17T12:32:48.854 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 1537ae18-1101-4a21-bec0-bb4c40999527' 2026-02-17T12:32:48.854 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:32:48.863 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDwX5RpfL5VMxAAP1hxBt37HolDa2f+ShPMcQ== 2026-02-17T12:32:48.863 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDwX5RpfL5VMxAAP1hxBt37HolDa2f+ShPMcQ=="}' 2026-02-17T12:32:48.863 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 1537ae18-1101-4a21-bec0-bb4c40999527 -i td/ceph-helpers/0/new.json 2026-02-17T12:32:48.966 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:32:48.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:32:48.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDwX5RpfL5VMxAAP1hxBt37HolDa2f+ShPMcQ== --osd-uuid 1537ae18-1101-4a21-bec0-bb4c40999527 2026-02-17T12:32:48.991 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:48.989+0000 7fd6a4823780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:48.992 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:48.991+0000 7fd6a4823780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:48.993 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:48.992+0000 7fd6a4823780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:48.994 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:48.992+0000 7fd6a4823780 -1 bdev(0x55761cf0bc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:32:48.994 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:48.992+0000 7fd6a4823780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:32:51.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:32:51.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:32:51.642 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:32:51.642 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:32:51.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:32:51.900 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:32:51.900 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:32:51.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:32:51.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:32:51.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:32:51.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:32:51.917 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:51.916+0000 7f5be079c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:51.919 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:51.917+0000 7f5be079c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:51.919 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:51.918+0000 7f5be079c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:32:52.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:32:52.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:32:52.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:32:52.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:32:52.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:32:52.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:52.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:32:52.087 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:32:52.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:52.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:52.273 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:53.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:53.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:53.275 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:32:53.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:32:53.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:53.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:53.276 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:53.274+0000 7f5be079c780 -1 Falling back to public interface 2026-02-17T12:32:53.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:54.463 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:54.463 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:54.463 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:32:54.464 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:32:54.464 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:54.464 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:54.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:55.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:55.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:55.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:32:55.651 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:32:55.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:55.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:55.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:32:55.993 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:32:55.992+0000 7f5be079c780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:32:56.840 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:32:56.841 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:32:56.841 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:32:56.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:32:56.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:32:56.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:32:57.033 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3211642895,v1:127.0.0.1:6803/3211642895] [v2:127.0.0.1:6804/3211642895,v1:127.0.0.1:6805/3211642895] exists,up 1537ae18-1101-4a21-bec0-bb4c40999527 2026-02-17T12:32:57.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:32:57.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:32:57.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:32:57.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:281: test_kill_daemon: name_prefix=osd 2026-02-17T12:32:57.034 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:282: test_kill_daemon: find td/ceph-helpers 2026-02-17T12:32:57.034 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:282: test_kill_daemon: grep 'osd[^/]*\.pid' 2026-02-17T12:32:57.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:282: test_kill_daemon: for pidfile in $(find $dir 2>/dev/null | grep $name_prefix'[^/]*\.pid') 2026-02-17T12:32:57.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:289: test_kill_daemon: kill_daemon td/ceph-helpers/osd.0.pid 0 1 2026-02-17T12:32:57.035 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/ceph-helpers/osd.0.pid 2026-02-17T12:32:57.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=126129 2026-02-17T12:32:57.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=0 2026-02-17T12:32:57.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local delays=1 2026-02-17T12:32:57.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2026-02-17T12:32:57.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2026-02-17T12:32:57.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 126129 2026-02-17T12:32:57.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2026-02-17T12:32:57.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2026-02-17T12:32:57.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 1 2026-02-17T12:32:58.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2026-02-17T12:32:58.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 126129 2026-02-17T12:32:58.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2026-02-17T12:32:58.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2026-02-17T12:32:58.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0 2026-02-17T12:32:58.039 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 1 2026-02-17T12:32:58.039 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:293: test_kill_daemon: kill_daemon td/ceph-helpers/osd.0.pid TERM 2026-02-17T12:32:58.039 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/ceph-helpers/osd.0.pid 2026-02-17T12:32:58.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=126129 2026-02-17T12:32:58.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2026-02-17T12:32:58.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2026-02-17T12:32:58.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2026-02-17T12:32:58.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2026-02-17T12:32:58.040 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 126129 2026-02-17T12:32:58.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2026-02-17T12:32:58.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2026-02-17T12:32:58.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2026-02-17T12:32:58.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2026-02-17T12:32:58.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 126129 2026-02-17T12:32:58.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2026-02-17T12:32:58.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2026-02-17T12:32:58.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.2 2026-02-17T12:32:58.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2026-02-17T12:32:58.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 126129 2026-02-17T12:32:58.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2026-02-17T12:32:58.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2026-02-17T12:32:58.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 1 2026-02-17T12:32:59.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2026-02-17T12:32:59.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 126129 2026-02-17T12:32:59.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2026-02-17T12:32:59.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2026-02-17T12:32:59.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2026-02-17T12:32:59.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:296: test_kill_daemon: name_prefix=mgr 2026-02-17T12:32:59.345 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:297: test_kill_daemon: find td/ceph-helpers 2026-02-17T12:32:59.345 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:297: test_kill_daemon: grep 'mgr[^/]*\.pid' 2026-02-17T12:32:59.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:297: test_kill_daemon: for pidfile in $(find $dir 2>/dev/null | grep $name_prefix'[^/]*\.pid') 2026-02-17T12:32:59.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:301: test_kill_daemon: kill_daemon td/ceph-helpers/mgr.x.pid TERM 2026-02-17T12:32:59.347 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/ceph-helpers/mgr.x.pid 2026-02-17T12:32:59.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=125183 2026-02-17T12:32:59.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2026-02-17T12:32:59.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2026-02-17T12:32:59.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2026-02-17T12:32:59.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2026-02-17T12:32:59.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 125183 2026-02-17T12:32:59.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2026-02-17T12:32:59.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2026-02-17T12:32:59.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2026-02-17T12:32:59.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2026-02-17T12:32:59.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 125183 2026-02-17T12:32:59.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2026-02-17T12:32:59.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2026-02-17T12:32:59.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2026-02-17T12:32:59.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:304: test_kill_daemon: name_prefix=mon 2026-02-17T12:32:59.451 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:305: test_kill_daemon: find td/ceph-helpers 2026-02-17T12:32:59.451 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:305: test_kill_daemon: grep 'mon[^/]*\.pid' 2026-02-17T12:32:59.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:305: test_kill_daemon: for pidfile in $(find $dir 2>/dev/null | grep $name_prefix'[^/]*\.pid') 2026-02-17T12:32:59.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:309: test_kill_daemon: kill_daemon td/ceph-helpers/mon.a.pid TERM 2026-02-17T12:32:59.453 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/ceph-helpers/mon.a.pid 2026-02-17T12:32:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=125098 2026-02-17T12:32:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2026-02-17T12:32:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2026-02-17T12:32:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2026-02-17T12:32:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2026-02-17T12:32:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 125098 2026-02-17T12:32:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2026-02-17T12:32:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2026-02-17T12:32:59.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2026-02-17T12:32:59.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2026-02-17T12:32:59.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 125098 2026-02-17T12:32:59.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2026-02-17T12:32:59.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2026-02-17T12:32:59.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.2 2026-02-17T12:32:59.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2026-02-17T12:32:59.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 125098 2026-02-17T12:32:59.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2026-02-17T12:32:59.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2026-02-17T12:32:59.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2026-02-17T12:32:59.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:310: test_kill_daemon: timeout 5 ceph status 2026-02-17T12:33:04.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:313: test_kill_daemon: teardown td/ceph-helpers 2026-02-17T12:33:04.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:33:04.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:33:04.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:33:04.762 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:04.762 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:04.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:04.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:04.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:04.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:33:04.767 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:33:04.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:33:04.768 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:33:04.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:33:04.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:33:04.769 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:33:04.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:04.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:33:04.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:33:04.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:04.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:33:04.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:33:04.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:33:04.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:33:04.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:04.775 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:04.775 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:33:04.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:33:04.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:33:04.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:33:04.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_kill_daemons td/ceph-helpers 2026-02-17T12:33:04.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:366: test_kill_daemons: local dir=td/ceph-helpers 2026-02-17T12:33:04.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:367: test_kill_daemons: setup td/ceph-helpers 2026-02-17T12:33:04.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:33:04.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:33:04.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:33:04.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:33:04.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:33:04.778 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:04.778 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:04.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:04.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:04.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:04.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:33:04.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:33:04.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:33:04.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:33:04.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:33:04.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:33:04.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:33:04.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:04.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:33:04.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:33:04.782 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:04.782 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:33:04.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:33:04.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:33:04.784 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:33:04.784 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:04.784 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:04.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:33:04.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:33:04.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:33:04.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:33:04.786 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:33:04.786 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:04.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:04.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:33:04.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:33:04.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:33:04.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:33:04.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:33:04.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:368: test_kill_daemons: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:33:04.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:33:04.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:33:04.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:33:04.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:33:04.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:33:04.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:33:04.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:33:04.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:33:04.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:33:04.811 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:33:04.811 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:04.811 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:04.811 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:04.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:33:04.837 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:33:04.838 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:33:04.838 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:33:04.838 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:33:04.838 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:33:04.839 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:33:04.839 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:33:04.839 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:33:04.839 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:33:04.840 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:33:04.840 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:04.840 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:04.840 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:33:04.840 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:33:04.840 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:33:04.884 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:33:04.885 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:33:04.885 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:33:04.885 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:33:04.885 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:33:04.886 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:33:04.886 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:33:04.886 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:33:04.886 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:33:04.887 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:04.887 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:04.887 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:33:04.887 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:33:04.887 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:33:04.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:369: test_kill_daemons: run_mgr td/ceph-helpers x 2026-02-17T12:33:04.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:33:04.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:33:04.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:33:04.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:33:04.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:33:04.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:33:05.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:33:05.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:33:05.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:33:05.030 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:33:05.031 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:05.031 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:05.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:05.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:33:05.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:33:05.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:370: test_kill_daemons: run_osd td/ceph-helpers 0 2026-02-17T12:33:05.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:33:05.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:33:05.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:33:05.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:33:05.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:33:05.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:33:05.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:33:05.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:33:05.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:33:05.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:05.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:33:05.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:33:05.054 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:33:05.054 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=768baad8-d591-4b62-8646-f99b88d44eba 2026-02-17T12:33:05.054 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 768baad8-d591-4b62-8646-f99b88d44eba' 2026-02-17T12:33:05.055 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 768baad8-d591-4b62-8646-f99b88d44eba 2026-02-17T12:33:05.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:33:05.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQABYJRp1+avAxAAytrKe9yfzBhjWEl3iByEEA== 2026-02-17T12:33:05.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQABYJRp1+avAxAAytrKe9yfzBhjWEl3iByEEA=="}' 2026-02-17T12:33:05.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 768baad8-d591-4b62-8646-f99b88d44eba -i td/ceph-helpers/0/new.json 2026-02-17T12:33:05.165 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:33:05.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:33:05.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQABYJRp1+avAxAAytrKe9yfzBhjWEl3iByEEA== --osd-uuid 768baad8-d591-4b62-8646-f99b88d44eba 2026-02-17T12:33:05.190 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:05.188+0000 7f39f921e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:05.191 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:05.190+0000 7f39f921e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:05.192 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:05.191+0000 7f39f921e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:05.193 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:05.191+0000 7f39f921e780 -1 bdev(0x56121f0e3c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:33:05.193 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:05.191+0000 7f39f921e780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:33:08.075 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:33:08.075 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:33:08.076 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:33:08.076 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:33:08.076 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:33:08.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:33:08.328 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:33:08.328 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:33:08.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:33:08.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:33:08.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:33:08.343 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:08.341+0000 7f69d8014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:08.345 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:08.342+0000 7f69d8014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:08.346 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:08.343+0000 7f69d8014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:08.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:33:08.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:33:08.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:33:08.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:33:08.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:33:08.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:08.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:33:08.517 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:33:08.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:08.518 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:08.705 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:09.706 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:09.706 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:09.707 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:33:09.707 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:33:09.707 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:09.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:09.894 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:09.936 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:09.934+0000 7f69d8014780 -1 Falling back to public interface 2026-02-17T12:33:10.895 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:10.895 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:10.895 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:33:10.895 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:33:10.895 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:10.895 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:11.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:12.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:12.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:12.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:33:12.088 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:33:12.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:12.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:12.277 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:12.873 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:12.871+0000 7f69d8014780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:33:13.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:13.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:13.279 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:33:13.279 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:33:13.279 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:13.279 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:13.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:14.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:14.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:14.471 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:33:14.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:33:14.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:14.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:14.659 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1101334405,v1:127.0.0.1:6803/1101334405] [v2:127.0.0.1:6804/1101334405,v1:127.0.0.1:6805/1101334405] exists,up 768baad8-d591-4b62-8646-f99b88d44eba 2026-02-17T12:33:14.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:33:14.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:33:14.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:33:14.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:377: test_kill_daemons: kill_daemons td/ceph-helpers 0 osd 1 2026-02-17T12:33:14.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:14.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:14.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:14.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:14.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:15.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 1 2026-02-17T12:33:15.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:381: test_kill_daemons: kill_daemons td/ceph-helpers TERM osd 2026-02-17T12:33:15.667 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:15.667 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:15.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:15.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:15.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:16.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:33:16.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:385: test_kill_daemons: kill_daemons td/ceph-helpers TERM mgr 2026-02-17T12:33:16.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:16.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:16.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:16.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:16.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:17.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:33:17.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:389: test_kill_daemons: kill_daemons td/ceph-helpers TERM 2026-02-17T12:33:17.084 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:17.084 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:17.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:17.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:17.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:17.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:33:17.393 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:390: test_kill_daemons: timeout 5 ceph status 2026-02-17T12:33:22.397 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:391: test_kill_daemons: teardown td/ceph-helpers 2026-02-17T12:33:22.397 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:33:22.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:33:22.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:33:22.398 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:22.398 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:22.399 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:22.399 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:22.399 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:22.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:33:22.403 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:33:22.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:33:22.404 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:33:22.405 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:33:22.405 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:33:22.405 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:33:22.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:22.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:33:22.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:33:22.406 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:22.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:33:22.408 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:33:22.408 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:33:22.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:33:22.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:22.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:22.411 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:33:22.413 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:33:22.413 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:33:22.413 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:33:22.413 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_objectstore_tool td/ceph-helpers 2026-02-17T12:33:22.413 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1307: test_objectstore_tool: local dir=td/ceph-helpers 2026-02-17T12:33:22.413 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1309: test_objectstore_tool: setup td/ceph-helpers 2026-02-17T12:33:22.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:33:22.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:33:22.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:33:22.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:33:22.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:33:22.414 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:22.414 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:22.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:22.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:22.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:22.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:33:22.415 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:33:22.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:33:22.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:33:22.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:33:22.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:33:22.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:33:22.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:22.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:33:22.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:33:22.418 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:22.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:33:22.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:33:22.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:33:22.420 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:33:22.421 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:22.421 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:22.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:33:22.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:33:22.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:33:22.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:33:22.422 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:33:22.423 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:22.423 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:22.423 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:33:22.424 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:33:22.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:33:22.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:33:22.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:33:22.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1310: test_objectstore_tool: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:33:22.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:33:22.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:33:22.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:33:22.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:33:22.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:33:22.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:33:22.444 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:33:22.444 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:33:22.445 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:33:22.445 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:33:22.445 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:22.445 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:22.445 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:22.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:33:22.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:33:22.471 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:33:22.471 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:33:22.472 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:33:22.472 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:33:22.472 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:33:22.473 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:33:22.473 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:33:22.473 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:33:22.473 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:33:22.473 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:22.473 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:22.473 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:33:22.474 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:33:22.474 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:33:22.517 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:33:22.517 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:33:22.517 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:33:22.517 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:33:22.517 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:33:22.519 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:33:22.519 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:33:22.519 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:33:22.519 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:33:22.519 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:22.519 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:22.519 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:33:22.519 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:33:22.519 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:33:22.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1311: test_objectstore_tool: local osd=0 2026-02-17T12:33:22.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1312: test_objectstore_tool: run_mgr td/ceph-helpers x 2026-02-17T12:33:22.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:33:22.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:33:22.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:33:22.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:33:22.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:33:22.567 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:33:22.665 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:33:22.665 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:33:22.666 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:33:22.666 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:33:22.666 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:22.666 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:22.666 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:22.667 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:33:22.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:33:22.686 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1313: test_objectstore_tool: run_osd td/ceph-helpers 0 2026-02-17T12:33:22.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:33:22.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:33:22.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:33:22.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:33:22.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:33:22.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:33:22.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:33:22.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:33:22.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:33:22.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:33:22.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:22.688 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:33:22.689 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:33:22.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ae765ec2-22f1-4878-8a68-aafc36f987a0 2026-02-17T12:33:22.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 ae765ec2-22f1-4878-8a68-aafc36f987a0' 2026-02-17T12:33:22.690 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 ae765ec2-22f1-4878-8a68-aafc36f987a0 2026-02-17T12:33:22.691 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:33:22.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQASYJRpyp2VKRAAeGH2V9y+2y3GjlXrVX/xRw== 2026-02-17T12:33:22.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQASYJRpyp2VKRAAeGH2V9y+2y3GjlXrVX/xRw=="}' 2026-02-17T12:33:22.700 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ae765ec2-22f1-4878-8a68-aafc36f987a0 -i td/ceph-helpers/0/new.json 2026-02-17T12:33:22.803 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:33:22.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:33:22.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQASYJRpyp2VKRAAeGH2V9y+2y3GjlXrVX/xRw== --osd-uuid ae765ec2-22f1-4878-8a68-aafc36f987a0 2026-02-17T12:33:22.829 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:22.826+0000 7f1732ff9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:22.830 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:22.828+0000 7f1732ff9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:22.831 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:22.829+0000 7f1732ff9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:22.832 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:22.829+0000 7f1732ff9780 -1 bdev(0x56344e635c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:33:22.832 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:22.829+0000 7f1732ff9780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:33:25.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:33:25.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:33:25.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:33:25.491 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:33:25.491 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:33:25.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:33:25.748 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:33:25.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:33:25.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:33:25.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:33:25.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:33:25.764 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:25.761+0000 7f5c7673d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:25.765 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:25.762+0000 7f5c7673d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:25.766 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:25.763+0000 7f5c7673d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:25.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:33:25.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:33:25.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:33:25.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:33:25.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:33:25.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:25.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:33:25.938 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:33:25.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:25.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:26.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:27.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:27.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:27.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:33:27.131 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:33:27.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:27.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:27.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:27.361 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:27.358+0000 7f5c7673d780 -1 Falling back to public interface 2026-02-17T12:33:28.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:28.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:28.320 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:33:28.321 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:33:28.321 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:28.321 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:28.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:29.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:29.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:29.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:33:29.517 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:33:29.518 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:29.518 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:29.707 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:30.300 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:30.298+0000 7f5c7673d780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:33:30.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:30.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:30.709 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:33:30.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:33:30.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:30.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:30.900 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:31.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:31.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:31.902 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:33:31.902 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:33:31.902 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:31.902 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:32.092 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3676315946,v1:127.0.0.1:6803/3676315946] [v2:127.0.0.1:6804/3676315946,v1:127.0.0.1:6805/3676315946] exists,up ae765ec2-22f1-4878-8a68-aafc36f987a0 2026-02-17T12:33:32.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:33:32.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:33:32.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:33:32.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1314: test_objectstore_tool: create_rbd_pool 2026-02-17T12:33:32.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:33:32.281 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:33:32.287 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:33:32.288 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:33:32.523 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:33:32.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:33:33.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:33:33.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1315: test_objectstore_tool: wait_for_clean 2026-02-17T12:33:33.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:33:33.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:33:33.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:33:33.814 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:33:33.814 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:33:33.814 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:33:33.815 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:33:33.815 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:33:33.815 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:33:33.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:33:33.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:33:33.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:33:33.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:33:33.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:33:33.897 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:33:34.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:33:34.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:33:34.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:33:34.092 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:33:34.154 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836483 2026-02-17T12:33:34.154 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836483 2026-02-17T12:33:34.154 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T12:33:34.154 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:33:34.155 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836483 2026-02-17T12:33:34.155 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:33:34.155 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:33:34.156 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836483 2026-02-17T12:33:34.156 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:33:34.157 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836483 2026-02-17T12:33:34.157 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836483 2026-02-17T12:33:34.157 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T12:33:34.158 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:33:34.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:33:34.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:33:35.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:33:35.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:33:35.538 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T12:33:35.538 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:33:35.538 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:33:35.538 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:33:35.791 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:33:35.791 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:33:35.791 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:33:35.791 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:33:35.791 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:33:35.792 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:33:35.792 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:33:35.792 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:33:35.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:33:35.979 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:33:35.979 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:33:35.980 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:33:36.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:33:36.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:33:36.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:33:36.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1316: test_objectstore_tool: rados --pool rbd put GROUP /etc/group 2026-02-17T12:33:36.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1317: test_objectstore_tool: objectstore_tool td/ceph-helpers 0 GROUP get-bytes 2026-02-17T12:33:36.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/ceph-helpers 2026-02-17T12:33:36.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T12:33:36.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=0 2026-02-17T12:33:36.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T12:33:36.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/ceph-helpers 0 GROUP get-bytes 2026-02-17T12:33:36.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1318: test_objectstore_tool: diff - /etc/group 2026-02-17T12:33:36.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/ceph-helpers 2026-02-17T12:33:36.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T12:33:36.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=0 2026-02-17T12:33:36.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T12:33:36.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/ceph-helpers TERM osd.0 2026-02-17T12:33:36.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:36.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:36.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:36.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:36.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:37.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:33:37.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/ceph-helpers 0 GROUP get-bytes 2026-02-17T12:33:37.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/ceph-helpers 2026-02-17T12:33:37.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T12:33:37.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=0 2026-02-17T12:33:37.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T12:33:37.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/ceph-helpers/0 2026-02-17T12:33:37.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/ceph-helpers/0 GROUP get-bytes 2026-02-17T12:33:38.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/ceph-helpers 0 2026-02-17T12:33:38.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ceph-helpers 2026-02-17T12:33:38.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:33:38.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T12:33:38.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:33:38.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:33:38.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:33:38.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:33:38.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:33:38.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:33:38.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:33:38.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:33:38.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:33:38.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:33:38.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:start osd.0 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ceph-helpers/0/whoami 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:33:38.371 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:33:38.372 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:33:38.387 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:38.384+0000 7f4edcd12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:38.388 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:38.386+0000 7f4edcd12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:38.389 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:38.387+0000 7f4edcd12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:38.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T12:33:38.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:33:38.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:33:38.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:33:38.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:33:38.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:38.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:33:38.559 INFO:tasks.workunit.client.0.trial155.stderr:0 2026-02-17T12:33:38.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:38.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:38.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:39.717 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:39.715+0000 7f4edcd12780 -1 Falling back to public interface 2026-02-17T12:33:39.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:39.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:39.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:33:39.747 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:33:39.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:39.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:39.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:40.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:40.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:40.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:33:40.939 INFO:tasks.workunit.client.0.trial155.stderr:2 2026-02-17T12:33:40.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:40.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:41.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:42.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:42.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:42.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:33:42.131 INFO:tasks.workunit.client.0.trial155.stderr:3 2026-02-17T12:33:42.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:42.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:42.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:42.417 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:42.414+0000 7f4edcd12780 -1 osd.0 11 log_to_monitors true 2026-02-17T12:33:43.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:43.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:43.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:33:43.324 INFO:tasks.workunit.client.0.trial155.stderr:4 2026-02-17T12:33:43.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:43.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:43.519 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 up in weight 1 up_from 15 up_thru 15 down_at 12 last_clean_interval [5,11) [v2:127.0.0.1:6802/3032900666,v1:127.0.0.1:6803/3032900666] [v2:127.0.0.1:6804/3032900666,v1:127.0.0.1:6805/3032900666] exists,up ae765ec2-22f1-4878-8a68-aafc36f987a0 2026-02-17T12:33:43.519 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:33:43.519 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:33:43.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:33:43.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T12:33:43.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:33:43.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:33:43.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:33:43.520 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:33:43.520 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:33:43.520 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:33:43.520 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:33:43.520 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:33:43.520 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:33:43.599 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:33:43.599 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:33:43.599 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:33:43.599 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:33:43.599 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:33:43.599 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:33:43.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:33:43.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:33:43.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:33:43.789 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:33:43.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=64424509443 2026-02-17T12:33:43.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 64424509443 2026-02-17T12:33:43.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-64424509443' 2026-02-17T12:33:43.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:33:43.851 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-64424509443 2026-02-17T12:33:43.851 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:33:43.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:33:43.852 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-64424509443 2026-02-17T12:33:43.852 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:33:43.853 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=64424509443 2026-02-17T12:33:43.853 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 64424509443' 2026-02-17T12:33:43.854 INFO:tasks.workunit.client.0.trial155.stderr:waiting osd.0 seq 64424509443 2026-02-17T12:33:43.854 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:33:44.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 1 -lt 64424509443 2026-02-17T12:33:44.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:33:45.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:33:45.044 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:33:45.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 64424509443 -lt 64424509443 2026-02-17T12:33:45.234 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:33:45.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:33:45.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:33:45.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:33:45.493 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:33:45.493 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:33:45.493 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:33:45.493 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:33:45.493 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:33:45.493 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:33:45.493 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:33:45.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:33:45.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:33:45.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:33:45.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:33:45.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:33:45.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:33:45.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1319: test_objectstore_tool: objectstore_tool td/ceph-helpers 0 NOTEXISTS get-bytes 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/ceph-helpers 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=0 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/ceph-helpers 0 NOTEXISTS get-bytes 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/ceph-helpers 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=0 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/ceph-helpers TERM osd.0 2026-02-17T12:33:45.930 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:45.931 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:45.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:45.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:45.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:47.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:33:47.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/ceph-helpers 0 NOTEXISTS get-bytes 2026-02-17T12:33:47.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/ceph-helpers 2026-02-17T12:33:47.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T12:33:47.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=0 2026-02-17T12:33:47.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T12:33:47.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/ceph-helpers/0 2026-02-17T12:33:47.238 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/ceph-helpers/0 NOTEXISTS get-bytes 2026-02-17T12:33:47.531 INFO:tasks.workunit.client.0.trial155.stderr:No object id 'NOTEXISTS' found or invalid JSON specified 2026-02-17T12:33:47.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nodown: return 1 2026-02-17T12:33:47.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: return 1 2026-02-17T12:33:47.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: return 1 2026-02-17T12:33:47.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1320: test_objectstore_tool: teardown td/ceph-helpers 2026-02-17T12:33:47.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:33:47.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:33:47.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:33:47.802 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:47.802 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:47.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:47.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:47.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:47.907 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:33:47.908 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:33:47.908 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:33:47.909 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:33:47.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:33:47.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:33:47.911 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:33:47.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:47.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:33:47.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:33:47.912 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:47.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:33:47.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:33:47.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:33:47.918 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:33:47.918 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:47.918 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:47.918 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:33:47.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:33:47.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:33:47.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:33:47.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_pg_schedule_scrub td/ceph-helpers 2026-02-17T12:33:47.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: test_pg_schedule_scrub: local dir=td/ceph-helpers 2026-02-17T12:33:47.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1998: test_pg_schedule_scrub: setup td/ceph-helpers 2026-02-17T12:33:47.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:33:47.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:33:47.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:33:47.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:33:47.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:33:47.921 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:33:47.921 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:33:47.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:33:47.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:33:47.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:33:47.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:33:47.922 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:33:47.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:33:47.923 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:33:47.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:33:47.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:33:47.924 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:33:47.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:47.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:33:47.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:33:47.925 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:33:47.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:33:47.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:33:47.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:33:47.927 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:33:47.928 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:47.928 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:47.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:33:47.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:33:47.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:33:47.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:33:47.930 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:33:47.930 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:47.930 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:47.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:33:47.931 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:33:47.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:33:47.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:33:47.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:33:47.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: test_pg_schedule_scrub: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:33:47.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:33:47.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:33:47.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:33:47.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:33:47.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:33:47.933 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:33:47.952 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:33:47.952 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:33:47.952 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:33:47.952 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:33:47.952 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:47.952 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:47.953 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:47.953 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:33:47.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:33:47.980 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:33:47.980 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:33:47.980 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:33:47.980 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:33:47.980 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:33:47.980 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:33:47.980 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:33:47.981 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:33:47.981 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:33:47.982 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:47.982 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:47.982 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:33:47.982 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:33:47.982 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:33:48.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:33:48.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:33:48.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:33:48.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:33:48.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:33:48.025 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:33:48.025 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:33:48.025 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:33:48.026 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:33:48.026 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:48.026 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:48.026 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:33:48.026 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:33:48.026 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:33:48.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: test_pg_schedule_scrub: run_mgr td/ceph-helpers x --mgr_stats_period=1 2026-02-17T12:33:48.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:33:48.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:33:48.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:33:48.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:33:48.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:33:48.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:33:48.169 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:33:48.169 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:33:48.170 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:33:48.170 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:33:48.170 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:48.170 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:48.170 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:48.171 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:33:48.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-17T12:33:48.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: test_pg_schedule_scrub: run_osd td/ceph-helpers 0 2026-02-17T12:33:48.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:33:48.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:33:48.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:33:48.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:33:48.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:33:48.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:33:48.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:33:48.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:33:48.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:33:48.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:33:48.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:33:48.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:33:48.194 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:33:48.195 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=357ccb27-8329-4a17-81dc-d77670be98de 2026-02-17T12:33:48.195 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 357ccb27-8329-4a17-81dc-d77670be98de' 2026-02-17T12:33:48.195 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 357ccb27-8329-4a17-81dc-d77670be98de 2026-02-17T12:33:48.195 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:33:48.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAsYJRpknQWDBAAnRAoC3kUOjP4sqI/4D3/oA== 2026-02-17T12:33:48.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAsYJRpknQWDBAAnRAoC3kUOjP4sqI/4D3/oA=="}' 2026-02-17T12:33:48.205 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 357ccb27-8329-4a17-81dc-d77670be98de -i td/ceph-helpers/0/new.json 2026-02-17T12:33:48.308 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:33:48.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:33:48.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAsYJRpknQWDBAAnRAoC3kUOjP4sqI/4D3/oA== --osd-uuid 357ccb27-8329-4a17-81dc-d77670be98de 2026-02-17T12:33:48.333 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:48.331+0000 7f5d9a482780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:48.334 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:48.333+0000 7f5d9a482780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:48.335 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:48.334+0000 7f5d9a482780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:48.336 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:48.334+0000 7f5d9a482780 -1 bdev(0x56161b507c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:33:48.336 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:48.334+0000 7f5d9a482780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:33:51.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:33:51.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:33:51.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:33:51.230 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:33:51.231 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:33:51.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:33:51.488 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:33:51.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:33:51.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:33:51.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:33:51.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:33:51.504 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:51.503+0000 7fa865c10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:51.506 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:51.504+0000 7fa865c10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:51.507 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:51.505+0000 7fa865c10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:33:51.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:33:51.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:33:51.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:33:51.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:33:51.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:33:51.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:51.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:33:51.678 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:33:51.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:51.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:51.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:52.837 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:52.836+0000 7fa865c10780 -1 Falling back to public interface 2026-02-17T12:33:52.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:52.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:52.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:33:52.870 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:33:52.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:52.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:53.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:54.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:54.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:54.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:33:54.061 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:33:54.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:54.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:54.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:55.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:55.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:55.254 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:33:55.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:33:55.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:55.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:55.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:33:55.537 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:33:55.536+0000 7fa865c10780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:33:56.446 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:33:56.447 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:33:56.447 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:33:56.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:33:56.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:33:56.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:33:56.635 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2903081345,v1:127.0.0.1:6803/2903081345] [v2:127.0.0.1:6804/2903081345,v1:127.0.0.1:6805/2903081345] exists,up 357ccb27-8329-4a17-81dc-d77670be98de 2026-02-17T12:33:56.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:33:56.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:33:56.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:33:56.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: test_pg_schedule_scrub: create_rbd_pool 2026-02-17T12:33:56.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:33:56.824 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:33:56.832 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:33:56.832 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:33:57.071 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:33:57.078 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:33:58.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:33:58.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2003: test_pg_schedule_scrub: wait_for_clean 2026-02-17T12:33:58.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:33:58.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:33:58.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:33:58.361 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:33:58.361 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:33:58.361 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:33:58.361 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:33:58.361 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:33:58.361 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:33:58.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:33:58.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:33:58.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:33:58.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:33:58.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:33:58.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:33:58.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:33:58.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:33:58.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:33:58.635 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:33:58.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836485 2026-02-17T12:33:58.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836485 2026-02-17T12:33:58.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T12:33:58.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:33:58.702 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836485 2026-02-17T12:33:58.702 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:33:58.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:33:58.703 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836485 2026-02-17T12:33:58.703 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:33:58.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836485 2026-02-17T12:33:58.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T12:33:58.705 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836485 2026-02-17T12:33:58.705 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:33:58.893 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-17T12:33:58.893 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:33:59.894 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:33:59.895 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:34:00.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-17T12:34:00.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:34:01.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:34:01.086 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:34:01.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836486 -lt 21474836485 2026-02-17T12:34:01.276 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:34:01.276 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:34:01.277 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:34:01.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:34:01.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:34:01.529 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:34:01.529 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:34:01.529 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:34:01.530 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:34:01.530 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:34:01.530 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:34:01.715 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:34:01.715 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:34:01.715 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:34:01.716 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:34:01.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:34:01.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:34:01.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:34:01.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2004: test_pg_schedule_scrub: pg_schedule_scrub 1.0 2026-02-17T12:34:01.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1978: pg_schedule_scrub: local pgid=1.0 2026-02-17T12:34:01.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1980: pg_schedule_scrub: wait_for_pg_clean 1.0 2026-02-17T12:34:01.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: local pg_id=1.0 2026-02-17T12:34:01.966 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1712: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T12:34:01.966 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:34:01.967 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:34:01.967 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:34:01.967 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:34:01.967 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:34:02.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1712: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T12:34:02.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1712: wait_for_pg_clean: local -a delays 2026-02-17T12:34:02.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1713: wait_for_pg_clean: local -i loop=0 2026-02-17T12:34:02.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1715: wait_for_pg_clean: flush_pg_stats 2026-02-17T12:34:02.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:34:02.167 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:34:02.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:34:02.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:34:02.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:34:02.357 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:34:02.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836490 2026-02-17T12:34:02.420 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836490 2026-02-17T12:34:02.420 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T12:34:02.420 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:34:02.420 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836490 2026-02-17T12:34:02.420 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:34:02.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:34:02.421 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836490 2026-02-17T12:34:02.421 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:34:02.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836490 2026-02-17T12:34:02.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T12:34:02.422 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836490 2026-02-17T12:34:02.423 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:34:02.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-17T12:34:02.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:34:03.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:34:03.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:34:03.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-17T12:34:03.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:34:04.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:34:04.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:34:04.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836492 -lt 21474836490 2026-02-17T12:34:04.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:34:04.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-17T12:34:04.998 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 0 2026-02-17T12:34:04.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:34:04.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:34:04.999 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:34:04.999 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:34:04.999 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:34:05.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state=active+clean 2026-02-17T12:34:05.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:34:05.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: break 2026-02-17T12:34:05.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1728: wait_for_pg_clean: return 0 2026-02-17T12:34:05.064 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1981: pg_schedule_scrub: get_last_scrub_stamp 1.0 2026-02-17T12:34:05.064 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:34:05.064 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:34:05.064 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:34:05.064 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:34:05.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1981: pg_schedule_scrub: local last_scrub=2026-02-17T12:33:57.021022+0000 2026-02-17T12:34:05.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1982: pg_schedule_scrub: ceph tell 1.0 schedule-scrub 2026-02-17T12:34:05.312 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:34:05.312 INFO:tasks.workunit.client.0.trial155.stdout: "deep": false, 2026-02-17T12:34:05.312 INFO:tasks.workunit.client.0.trial155.stdout: "must": false, 2026-02-17T12:34:05.312 INFO:tasks.workunit.client.0.trial155.stdout: "stamp": "2026-02-10T12:32:25.311164+0000" 2026-02-17T12:34:05.312 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:34:05.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1983: pg_schedule_scrub: wait_for_scrub 1.0 2026-02-17T12:33:57.021022+0000 2026-02-17T12:34:05.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: wait_for_scrub: local pgid=1.0 2026-02-17T12:34:05.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: wait_for_scrub: local last_scrub=2026-02-17T12:33:57.021022+0000 2026-02-17T12:34:05.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T12:34:05.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i=0 )) 2026-02-17T12:34:05.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:34:05.317 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:34:05.317 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:34:05.318 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:34:05.318 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:34:05.318 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:34:05.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:33:57.021022+0000 '>' 2026-02-17T12:33:57.021022+0000 2026-02-17T12:34:05.501 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:34:06.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:34:06.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:34:06.503 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:34:06.503 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:34:06.503 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:34:06.503 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:34:06.503 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:34:06.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:34:05.485184+0000 '>' 2026-02-17T12:33:57.021022+0000 2026-02-17T12:34:06.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: wait_for_scrub: return 0 2026-02-17T12:34:06.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2005: test_pg_schedule_scrub: teardown td/ceph-helpers 2026-02-17T12:34:06.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:34:06.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:34:06.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:34:06.692 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:34:06.692 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:34:06.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:34:06.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:34:06.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:34:06.798 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:34:06.798 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:34:06.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:34:06.799 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:34:06.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:34:06.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:34:06.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:34:06.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:34:06.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:34:06.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:34:06.802 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:34:06.803 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:34:06.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:34:06.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:34:06.808 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:34:06.808 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:34:06.808 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:34:06.808 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:34:06.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:34:06.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:34:06.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:34:06.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_pg_scrub td/ceph-helpers 2026-02-17T12:34:06.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1950: test_pg_scrub: local dir=td/ceph-helpers 2026-02-17T12:34:06.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1952: test_pg_scrub: setup td/ceph-helpers 2026-02-17T12:34:06.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:34:06.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:34:06.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:34:06.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:34:06.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:34:06.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:34:06.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:34:06.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:34:06.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:34:06.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:34:06.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:34:06.811 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:34:06.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:34:06.812 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:34:06.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:34:06.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:34:06.813 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:34:06.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:34:06.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:34:06.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:34:06.815 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:34:06.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:34:06.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:34:06.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:34:06.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:34:06.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:34:06.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:34:06.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:34:06.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:34:06.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:34:06.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:34:06.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:34:06.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:34:06.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:34:06.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:34:06.821 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:34:06.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:34:06.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:34:06.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:34:06.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1953: test_pg_scrub: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:34:06.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:34:06.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:34:06.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:34:06.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:34:06.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:34:06.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:34:06.842 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:34:06.842 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:34:06.842 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:34:06.843 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:34:06.843 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:34:06.843 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:34:06.843 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:34:06.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:34:06.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:34:06.870 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:34:06.870 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:34:06.870 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:34:06.870 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:34:06.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:34:06.872 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:34:06.872 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:34:06.872 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:34:06.872 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:34:06.872 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:34:06.872 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:34:06.872 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:34:06.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:34:06.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:34:06.917 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:34:06.918 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:34:06.918 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:34:06.918 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:34:06.918 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:34:06.919 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:34:06.919 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:34:06.919 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:34:06.919 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:34:06.919 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:34:06.919 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:34:06.919 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:34:06.919 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:34:06.919 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:34:06.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1954: test_pg_scrub: run_mgr td/ceph-helpers x 2026-02-17T12:34:06.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:34:06.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:34:06.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:34:06.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:34:06.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:34:06.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:34:07.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:34:07.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:34:07.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:34:07.065 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:34:07.065 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:34:07.065 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:34:07.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:34:07.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:34:07.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1955: test_pg_scrub: run_osd td/ceph-helpers 0 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:34:07.084 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:34:07.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:34:07.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:34:07.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:34:07.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:34:07.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:34:07.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:34:07.085 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:34:07.085 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:34:07.085 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:34:07.085 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:34:07.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:34:07.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:34:07.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:34:07.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:34:07.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:34:07.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:34:07.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:34:07.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:34:07.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:34:07.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:34:07.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:34:07.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:34:07.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:34:07.087 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:34:07.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=f82780e6-fc85-475c-8969-1fbea8e37209 2026-02-17T12:34:07.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 f82780e6-fc85-475c-8969-1fbea8e37209' 2026-02-17T12:34:07.088 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 f82780e6-fc85-475c-8969-1fbea8e37209 2026-02-17T12:34:07.088 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:34:07.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA/YJRpjYvGBRAAIN6VJrGeGQM028LQAyhWzQ== 2026-02-17T12:34:07.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA/YJRpjYvGBRAAIN6VJrGeGQM028LQAyhWzQ=="}' 2026-02-17T12:34:07.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new f82780e6-fc85-475c-8969-1fbea8e37209 -i td/ceph-helpers/0/new.json 2026-02-17T12:34:07.202 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:34:07.209 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:34:07.210 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA/YJRpjYvGBRAAIN6VJrGeGQM028LQAyhWzQ== --osd-uuid f82780e6-fc85-475c-8969-1fbea8e37209 2026-02-17T12:34:07.228 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:34:07.227+0000 7f4100ae7780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:34:07.229 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:34:07.228+0000 7f4100ae7780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:34:07.230 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:34:07.229+0000 7f4100ae7780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:34:07.231 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:34:07.229+0000 7f4100ae7780 -1 bdev(0x563e1c2c3c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:34:07.231 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:34:07.229+0000 7f4100ae7780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:34:10.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:34:10.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:34:10.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:34:10.127 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:34:10.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:34:10.397 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:34:10.397 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:34:10.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:34:10.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:34:10.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:34:10.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:34:10.414 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:34:10.413+0000 7ff07fc15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:34:10.416 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:34:10.414+0000 7ff07fc15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:34:10.417 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:34:10.415+0000 7ff07fc15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:34:10.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:34:10.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:34:10.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:34:10.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:34:10.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:34:10.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:34:10.588 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:34:10.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:34:10.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:34:10.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:34:10.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:34:11.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:34:11.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:34:11.785 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:34:11.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:34:11.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:34:11.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:34:11.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:34:12.250 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:34:12.248+0000 7ff07fc15780 -1 Falling back to public interface 2026-02-17T12:34:12.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:34:12.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:34:12.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:34:12.977 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:34:12.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:34:12.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:34:13.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:34:14.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:34:14.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:34:14.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:34:14.168 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:34:14.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:34:14.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:34:14.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:34:14.951 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:34:14.950+0000 7ff07fc15780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:34:15.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:34:15.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:34:15.356 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:34:15.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:34:15.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:34:15.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:34:15.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:34:16.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:34:16.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:34:16.546 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:34:16.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:34:16.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:34:16.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:34:16.737 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2949332662,v1:127.0.0.1:6803/2949332662] [v2:127.0.0.1:6804/2949332662,v1:127.0.0.1:6805/2949332662] exists,up f82780e6-fc85-475c-8969-1fbea8e37209 2026-02-17T12:34:16.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:34:16.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:34:16.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:34:16.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1956: test_pg_scrub: create_rbd_pool 2026-02-17T12:34:16.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:34:16.925 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:34:16.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:34:16.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:34:17.170 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:34:17.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:34:18.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:34:18.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1957: test_pg_scrub: wait_for_clean 2026-02-17T12:34:18.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:34:18.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:34:18.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:34:18.460 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:34:18.461 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:34:18.462 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:34:18.462 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:34:18.462 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:34:18.462 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:34:18.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:34:18.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:34:18.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:34:18.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:34:18.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:34:18.545 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:34:18.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:34:18.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:34:18.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:34:18.737 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:34:18.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836483 2026-02-17T12:34:18.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836483 2026-02-17T12:34:18.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T12:34:18.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:34:18.800 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836483 2026-02-17T12:34:18.800 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:34:18.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:34:18.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836483 2026-02-17T12:34:18.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:34:18.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836483 2026-02-17T12:34:18.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T12:34:18.803 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836483 2026-02-17T12:34:18.803 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:34:18.989 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:34:18.989 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:34:19.990 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:34:19.991 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:34:20.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T12:34:20.180 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:34:20.180 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:34:20.181 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:34:20.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:34:20.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:34:20.429 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:34:20.429 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:34:20.429 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:34:20.429 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:34:20.429 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:34:20.429 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:34:20.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:34:20.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:34:20.614 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:34:20.614 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:34:20.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:34:20.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:34:20.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:34:20.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1958: test_pg_scrub: pg_scrub 1.0 2026-02-17T12:34:20.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_scrub: local pgid=1.0 2026-02-17T12:34:20.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_scrub: wait_for_pg_clean 1.0 2026-02-17T12:34:20.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: local pg_id=1.0 2026-02-17T12:34:20.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1712: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T12:34:20.872 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:34:20.872 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:34:20.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:34:20.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:34:20.872 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:34:21.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1712: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T12:34:21.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1712: wait_for_pg_clean: local -a delays 2026-02-17T12:34:21.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1713: wait_for_pg_clean: local -i loop=0 2026-02-17T12:34:21.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1715: wait_for_pg_clean: flush_pg_stats 2026-02-17T12:34:21.072 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:34:21.072 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:34:21.259 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:34:21.259 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:34:21.259 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:34:21.259 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:34:21.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836486 2026-02-17T12:34:21.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836486 2026-02-17T12:34:21.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836486' 2026-02-17T12:34:21.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:34:21.325 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836486 2026-02-17T12:34:21.325 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:34:21.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:34:21.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836486 2026-02-17T12:34:21.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:34:21.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836486 2026-02-17T12:34:21.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-17T12:34:21.328 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836486 2026-02-17T12:34:21.328 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:34:21.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836486 2026-02-17T12:34:21.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:34:22.518 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:34:22.518 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:34:22.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836486 2026-02-17T12:34:22.705 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:34:23.705 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:34:23.706 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:34:23.896 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836486 -lt 21474836486 2026-02-17T12:34:23.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:34:23.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-17T12:34:23.897 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 0 2026-02-17T12:34:23.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:34:23.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:34:23.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:34:23.898 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:34:23.898 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:34:23.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state=active+clean 2026-02-17T12:34:23.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:34:23.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: break 2026-02-17T12:34:23.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1728: wait_for_pg_clean: return 0 2026-02-17T12:34:23.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_scrub: get_last_scrub_stamp 1.0 2026-02-17T12:34:23.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:34:23.962 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:34:23.962 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:34:23.962 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:34:24.147 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_scrub: local last_scrub=2026-02-17T12:34:17.119395+0000 2026-02-17T12:34:24.147 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_scrub: ceph pg scrub 1.0 2026-02-17T12:34:24.330 INFO:tasks.workunit.client.0.trial155.stderr:instructing pg 1.0 on osd.0 to scrub 2026-02-17T12:34:24.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_scrub: wait_for_scrub 1.0 2026-02-17T12:34:17.119395+0000 2026-02-17T12:34:24.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: wait_for_scrub: local pgid=1.0 2026-02-17T12:34:24.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: wait_for_scrub: local last_scrub=2026-02-17T12:34:17.119395+0000 2026-02-17T12:34:24.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T12:34:24.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i=0 )) 2026-02-17T12:34:24.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:34:24.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:34:24.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:34:24.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:34:24.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:34:24.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:34:24.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:34:17.119395+0000 '>' 2026-02-17T12:34:17.119395+0000 2026-02-17T12:34:24.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:34:25.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:34:25.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:34:25.526 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:34:25.526 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:34:25.526 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:34:25.526 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:34:25.526 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:34:25.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:34:17.119395+0000 '>' 2026-02-17T12:34:17.119395+0000 2026-02-17T12:34:25.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:34:26.715 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:34:26.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:34:26.717 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:34:26.717 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:34:26.717 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:34:26.717 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:34:26.717 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:34:26.902 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:34:17.119395+0000 '>' 2026-02-17T12:34:17.119395+0000 2026-02-17T12:34:26.902 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:34:27.902 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:34:27.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:34:27.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:34:27.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:34:27.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:34:27.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:34:27.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:34:28.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:34:24.919166+0000 '>' 2026-02-17T12:34:17.119395+0000 2026-02-17T12:34:28.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: wait_for_scrub: return 0 2026-02-17T12:34:28.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1959: test_pg_scrub: kill_daemons td/ceph-helpers KILL osd 2026-02-17T12:34:28.093 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:34:28.093 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:34:28.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:34:28.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:34:28.093 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:34:28.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:34:28.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1960: test_pg_scrub: TIMEOUT=1 2026-02-17T12:34:28.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1960: test_pg_scrub: pg_scrub 1.0 2026-02-17T12:34:28.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_scrub: local pgid=1.0 2026-02-17T12:34:28.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_scrub: wait_for_pg_clean 1.0 2026-02-17T12:34:28.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1711: wait_for_pg_clean: local pg_id=1.0 2026-02-17T12:34:28.199 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1712: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T12:34:28.200 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:34:28.200 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:34:28.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:34:28.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:34:28.201 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:34:28.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1712: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T12:34:28.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1712: wait_for_pg_clean: local -a delays 2026-02-17T12:34:28.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1713: wait_for_pg_clean: local -i loop=0 2026-02-17T12:34:28.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1715: wait_for_pg_clean: flush_pg_stats 2026-02-17T12:34:28.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=1 2026-02-17T12:34:28.402 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:34:28.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:34:28.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:34:28.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:34:28.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:49:16.900 INFO:tasks.workunit.client.0.trial155.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-17T12:49:16.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq= 2026-02-17T12:49:16.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z '' 2026-02-17T12:49:16.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: continue 2026-02-17T12:49:16.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:16.903 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 0 2026-02-17T12:49:16.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-17T12:49:16.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:16.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:16.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:16.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:16.907 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:16.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:16.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:16.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 0 >= 31 )) 2026-02-17T12:49:16.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 1 2026-02-17T12:49:17.959 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:17.959 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:17.959 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 1' 2026-02-17T12:49:17.959 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 1 2026-02-17T12:49:17.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:17.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:17.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:17.960 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:17.960 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:18.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:18.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:18.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 1 >= 31 )) 2026-02-17T12:49:18.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 2 2026-02-17T12:49:20.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:20.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:20.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 2' 2026-02-17T12:49:20.013 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 2 2026-02-17T12:49:20.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:20.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:20.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:20.013 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:20.013 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:20.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:20.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:20.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 2 >= 31 )) 2026-02-17T12:49:20.068 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:23.068 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:23.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:23.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 3' 2026-02-17T12:49:23.069 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 3 2026-02-17T12:49:23.070 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:23.070 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:23.070 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:23.070 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:23.070 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:23.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:23.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:23.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 3 >= 31 )) 2026-02-17T12:49:23.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:26.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:26.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:26.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 4' 2026-02-17T12:49:26.123 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 4 2026-02-17T12:49:26.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:26.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:26.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:26.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:26.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:26.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:26.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:26.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 4 >= 31 )) 2026-02-17T12:49:26.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:29.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:29.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:29.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 5' 2026-02-17T12:49:29.177 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 5 2026-02-17T12:49:29.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:29.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:29.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:29.179 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:29.179 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:29.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:29.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:29.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 5 >= 31 )) 2026-02-17T12:49:29.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:32.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:32.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:32.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 6' 2026-02-17T12:49:32.230 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 6 2026-02-17T12:49:32.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:32.231 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:32.231 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:32.231 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:32.231 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:32.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:32.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:32.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 6 >= 31 )) 2026-02-17T12:49:32.282 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:35.282 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:35.283 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:35.283 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 7' 2026-02-17T12:49:35.283 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 7 2026-02-17T12:49:35.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:35.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:35.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:35.284 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:35.284 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:35.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:35.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:35.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 7 >= 31 )) 2026-02-17T12:49:35.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:38.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:38.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:38.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 8' 2026-02-17T12:49:38.337 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 8 2026-02-17T12:49:38.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:38.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:38.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:38.338 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:38.338 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:38.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:38.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:38.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 8 >= 31 )) 2026-02-17T12:49:38.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:41.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:41.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:41.388 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 9 2026-02-17T12:49:41.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 9' 2026-02-17T12:49:41.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:41.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:41.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:41.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:41.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:41.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:41.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:41.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 9 >= 31 )) 2026-02-17T12:49:41.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:44.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:44.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:44.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 10' 2026-02-17T12:49:44.442 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 10 2026-02-17T12:49:44.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:44.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:44.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:44.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:44.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:44.494 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:44.494 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:44.494 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 10 >= 31 )) 2026-02-17T12:49:44.494 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:47.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:47.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:47.495 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 11' 2026-02-17T12:49:47.496 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 11 2026-02-17T12:49:47.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:47.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:47.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:47.497 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:47.497 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:47.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:47.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:47.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 11 >= 31 )) 2026-02-17T12:49:47.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:50.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:50.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:50.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 12' 2026-02-17T12:49:50.548 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 12 2026-02-17T12:49:50.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:50.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:50.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:50.549 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:50.549 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:50.601 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:50.601 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:50.601 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 12 >= 31 )) 2026-02-17T12:49:50.601 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:53.603 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:53.603 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:53.603 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 13 2026-02-17T12:49:53.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 13' 2026-02-17T12:49:53.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:53.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:53.605 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:53.605 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:53.605 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:53.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:53.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:53.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 13 >= 31 )) 2026-02-17T12:49:53.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:56.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:56.656 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:56.656 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 14' 2026-02-17T12:49:56.656 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 14 2026-02-17T12:49:56.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:56.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:56.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:56.657 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:56.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:56.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:56.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:56.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 14 >= 31 )) 2026-02-17T12:49:56.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:49:59.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:49:59.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:49:59.710 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 15 2026-02-17T12:49:59.710 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 15' 2026-02-17T12:49:59.710 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:49:59.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:49:59.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:49:59.711 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:49:59.711 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:49:59.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:49:59.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:49:59.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 15 >= 31 )) 2026-02-17T12:49:59.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:02.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:02.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:02.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 16' 2026-02-17T12:50:02.763 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 16 2026-02-17T12:50:02.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:02.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:02.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:02.764 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:02.764 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:02.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:02.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:02.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 16 >= 31 )) 2026-02-17T12:50:02.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:05.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:05.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:05.815 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 17 2026-02-17T12:50:05.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 17' 2026-02-17T12:50:05.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:05.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:05.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:05.816 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:05.816 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:05.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:05.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:05.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 17 >= 31 )) 2026-02-17T12:50:05.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:08.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:08.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:08.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 18' 2026-02-17T12:50:08.869 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 18 2026-02-17T12:50:08.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:08.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:08.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:08.870 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:08.870 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:08.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:08.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:08.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 18 >= 31 )) 2026-02-17T12:50:08.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:11.921 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:11.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:11.922 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 19' 2026-02-17T12:50:11.922 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 19 2026-02-17T12:50:11.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:11.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:11.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:11.923 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:11.923 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:11.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:11.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:11.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 19 >= 31 )) 2026-02-17T12:50:11.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:14.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:14.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:14.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 20' 2026-02-17T12:50:14.976 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 20 2026-02-17T12:50:14.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:14.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:14.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:14.977 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:14.977 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:15.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:15.027 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:15.027 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 20 >= 31 )) 2026-02-17T12:50:15.027 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:18.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:18.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:18.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 21' 2026-02-17T12:50:18.028 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 21 2026-02-17T12:50:18.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:18.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:18.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:18.029 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:18.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:18.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:18.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:18.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 21 >= 31 )) 2026-02-17T12:50:18.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:21.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:21.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:21.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 22' 2026-02-17T12:50:21.082 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 22 2026-02-17T12:50:21.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:21.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:21.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:21.084 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:21.084 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:21.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:21.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:21.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 22 >= 31 )) 2026-02-17T12:50:21.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:24.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:24.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:24.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 23' 2026-02-17T12:50:24.138 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 23 2026-02-17T12:50:24.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:24.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:24.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:24.139 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:24.139 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:24.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:24.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:24.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 23 >= 31 )) 2026-02-17T12:50:24.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:27.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:27.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:27.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 24' 2026-02-17T12:50:27.192 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 24 2026-02-17T12:50:27.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:27.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:27.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:27.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:27.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:27.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:27.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:27.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 24 >= 31 )) 2026-02-17T12:50:27.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:30.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:30.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:30.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 25' 2026-02-17T12:50:30.245 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 25 2026-02-17T12:50:30.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:30.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:30.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:30.247 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:30.247 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:30.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:30.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:30.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 25 >= 31 )) 2026-02-17T12:50:30.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:33.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:33.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:33.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 26' 2026-02-17T12:50:33.299 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 26 2026-02-17T12:50:33.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:33.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:33.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:33.300 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:33.300 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:33.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:33.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:33.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 26 >= 31 )) 2026-02-17T12:50:33.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:36.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:36.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:36.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 27' 2026-02-17T12:50:36.353 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 27 2026-02-17T12:50:36.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:36.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:36.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:36.354 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:36.354 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:36.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:36.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:36.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 27 >= 31 )) 2026-02-17T12:50:36.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:39.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:39.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:39.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 28' 2026-02-17T12:50:39.407 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 28 2026-02-17T12:50:39.408 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:39.408 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:39.409 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:39.409 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:39.409 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 28 >= 31 )) 2026-02-17T12:50:39.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:42.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:42.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:42.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 29' 2026-02-17T12:50:42.460 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 29 2026-02-17T12:50:42.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:42.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:42.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:42.461 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:42.461 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:42.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:42.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:42.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 29 >= 31 )) 2026-02-17T12:50:42.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:45.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:45.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:45.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 30' 2026-02-17T12:50:45.514 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 30 2026-02-17T12:50:45.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:45.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:45.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:45.516 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:45.516 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:45.565 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:45.565 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:45.565 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 30 >= 31 )) 2026-02-17T12:50:45.565 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: wait_for_pg_clean: sleep 3 2026-02-17T12:50:48.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1726: wait_for_pg_clean: loop+=1 2026-02-17T12:50:48.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_pg_clean: true 2026-02-17T12:50:48.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1718: wait_for_pg_clean: echo '#---------- 1.0 loop 31' 2026-02-17T12:50:48.567 INFO:tasks.workunit.client.0.trial155.stdout:#---------- 1.0 loop 31 2026-02-17T12:50:48.567 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T12:50:48.567 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: is_pg_clean: local pgid=1.0 2026-02-17T12:50:48.568 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: is_pg_clean: local pg_state 2026-02-17T12:50:48.568 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: ceph pg 1.0 query 2026-02-17T12:50:48.568 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: jq -r '.state ' 2026-02-17T12:50:48.618 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: is_pg_clean: pg_state= 2026-02-17T12:50:48.619 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: is_pg_clean: [[ '' == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T12:50:48.619 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1720: wait_for_pg_clean: (( 31 >= 31 )) 2026-02-17T12:50:48.619 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1721: wait_for_pg_clean: ceph report 2026-02-17T12:50:48.864 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:50:48.864 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_fingerprint": "eaa6dbe5-73f5-4e2c-9671-ed50b68bd013", 2026-02-17T12:50:48.865 INFO:tasks.workunit.client.0.trial155.stdout: "version": "19.2.3-675-g3c96dfb3", 2026-02-17T12:50:48.865 INFO:tasks.workunit.client.0.trial155.stdout: "commit": "3c96dfb3f50b3d02598a82af7104764bfdcd3919", 2026-02-17T12:50:48.865 INFO:tasks.workunit.client.0.trial155.stdout: "timestamp": "2026-02-17T12:50:48.863190+0000", 2026-02-17T12:50:48.865 INFO:tasks.workunit.client.0.trial155.stdout: "tag": "", 2026-02-17T12:50:48.865 INFO:tasks.workunit.client.0.trial155.stdout: "health": { 2026-02-17T12:50:48.865 INFO:tasks.workunit.client.0.trial155.stdout: "status": "HEALTH_WARN", 2026-02-17T12:50:48.865 INFO:tasks.workunit.client.0.trial155.stdout: "checks": { 2026-02-17T12:50:48.866 INFO:tasks.workunit.client.0.trial155.stdout: "OSD_DOWN": { 2026-02-17T12:50:48.866 INFO:tasks.workunit.client.0.trial155.stdout: "severity": "HEALTH_WARN", 2026-02-17T12:50:48.866 INFO:tasks.workunit.client.0.trial155.stdout: "summary": { 2026-02-17T12:50:48.866 INFO:tasks.workunit.client.0.trial155.stdout: "message": "1 osds down", 2026-02-17T12:50:48.866 INFO:tasks.workunit.client.0.trial155.stdout: "count": 1 2026-02-17T12:50:48.866 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.866 INFO:tasks.workunit.client.0.trial155.stdout: "detail": [ 2026-02-17T12:50:48.866 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.867 INFO:tasks.workunit.client.0.trial155.stdout: "message": "osd.0 (root=default,host=trial155) is down" 2026-02-17T12:50:48.867 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.867 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.867 INFO:tasks.workunit.client.0.trial155.stdout: "muted": false 2026-02-17T12:50:48.867 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.867 INFO:tasks.workunit.client.0.trial155.stdout: "OSD_HOST_DOWN": { 2026-02-17T12:50:48.867 INFO:tasks.workunit.client.0.trial155.stdout: "severity": "HEALTH_WARN", 2026-02-17T12:50:48.867 INFO:tasks.workunit.client.0.trial155.stdout: "summary": { 2026-02-17T12:50:48.868 INFO:tasks.workunit.client.0.trial155.stdout: "message": "1 host (1 osds) down", 2026-02-17T12:50:48.868 INFO:tasks.workunit.client.0.trial155.stdout: "count": 1 2026-02-17T12:50:48.868 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.868 INFO:tasks.workunit.client.0.trial155.stdout: "detail": [ 2026-02-17T12:50:48.868 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.868 INFO:tasks.workunit.client.0.trial155.stdout: "message": "host trial155 (root=default) (1 osds) is down" 2026-02-17T12:50:48.868 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.868 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.869 INFO:tasks.workunit.client.0.trial155.stdout: "muted": false 2026-02-17T12:50:48.869 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.869 INFO:tasks.workunit.client.0.trial155.stdout: "OSD_ROOT_DOWN": { 2026-02-17T12:50:48.869 INFO:tasks.workunit.client.0.trial155.stdout: "severity": "HEALTH_WARN", 2026-02-17T12:50:48.869 INFO:tasks.workunit.client.0.trial155.stdout: "summary": { 2026-02-17T12:50:48.869 INFO:tasks.workunit.client.0.trial155.stdout: "message": "1 root (1 osds) down", 2026-02-17T12:50:48.869 INFO:tasks.workunit.client.0.trial155.stdout: "count": 1 2026-02-17T12:50:48.869 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.869 INFO:tasks.workunit.client.0.trial155.stdout: "detail": [ 2026-02-17T12:50:48.870 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.870 INFO:tasks.workunit.client.0.trial155.stdout: "message": "root default (1 osds) is down" 2026-02-17T12:50:48.870 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.870 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.870 INFO:tasks.workunit.client.0.trial155.stdout: "muted": false 2026-02-17T12:50:48.870 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.870 INFO:tasks.workunit.client.0.trial155.stdout: "PG_AVAILABILITY": { 2026-02-17T12:50:48.870 INFO:tasks.workunit.client.0.trial155.stdout: "severity": "HEALTH_WARN", 2026-02-17T12:50:48.871 INFO:tasks.workunit.client.0.trial155.stdout: "summary": { 2026-02-17T12:50:48.871 INFO:tasks.workunit.client.0.trial155.stdout: "message": "Reduced data availability: 4 pgs stale", 2026-02-17T12:50:48.871 INFO:tasks.workunit.client.0.trial155.stdout: "count": 4 2026-02-17T12:50:48.871 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.871 INFO:tasks.workunit.client.0.trial155.stdout: "detail": [ 2026-02-17T12:50:48.871 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.871 INFO:tasks.workunit.client.0.trial155.stdout: "message": "pg 1.0 is stuck stale for 90s, current state stale+active+clean, last acting [0]" 2026-02-17T12:50:48.871 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.872 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.872 INFO:tasks.workunit.client.0.trial155.stdout: "message": "pg 1.1 is stuck stale for 90s, current state stale+active+clean, last acting [0]" 2026-02-17T12:50:48.872 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.872 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.872 INFO:tasks.workunit.client.0.trial155.stdout: "message": "pg 1.2 is stuck stale for 90s, current state stale+active+clean, last acting [0]" 2026-02-17T12:50:48.872 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.872 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.872 INFO:tasks.workunit.client.0.trial155.stdout: "message": "pg 1.3 is stuck stale for 90s, current state stale+active+clean, last acting [0]" 2026-02-17T12:50:48.873 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.873 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.873 INFO:tasks.workunit.client.0.trial155.stdout: "muted": false 2026-02-17T12:50:48.873 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.873 INFO:tasks.workunit.client.0.trial155.stdout: "POOL_NO_REDUNDANCY": { 2026-02-17T12:50:48.873 INFO:tasks.workunit.client.0.trial155.stdout: "severity": "HEALTH_WARN", 2026-02-17T12:50:48.873 INFO:tasks.workunit.client.0.trial155.stdout: "summary": { 2026-02-17T12:50:48.873 INFO:tasks.workunit.client.0.trial155.stdout: "message": "1 pool(s) have no replicas configured", 2026-02-17T12:50:48.873 INFO:tasks.workunit.client.0.trial155.stdout: "count": 1 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: "detail": [ 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: "message": "pool 'rbd' has no replicas configured" 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: "muted": false 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: "TOO_FEW_OSDS": { 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: "severity": "HEALTH_WARN", 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: "summary": { 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: "message": "OSD count 1 < osd_pool_default_size 3", 2026-02-17T12:50:48.874 INFO:tasks.workunit.client.0.trial155.stdout: "count": 2 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: "detail": [], 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: "muted": false 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: "mutes": [] 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: "monmap_first_committed": 1, 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: "monmap_last_committed": 1, 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: "monmap": { 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 1, 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: "fsid": "af5bea88-7d02-4f39-9b2e-26dff0e1f9f6", 2026-02-17T12:50:48.875 INFO:tasks.workunit.client.0.trial155.stdout: "modified": "2026-02-17T12:34:06.835734Z", 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "created": "2026-02-17T12:34:06.835734Z", 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "min_mon_release": 19, 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "min_mon_release_name": "squid", 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "election_strategy": 1, 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "disallowed_leaders": "", 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode": false, 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "tiebreaker_mon": "", 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "removed_ranks": "", 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "features": { 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "persistent": [ 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "kraken", 2026-02-17T12:50:48.876 INFO:tasks.workunit.client.0.trial155.stdout: "luminous", 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: "mimic", 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap-prune", 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: "nautilus", 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: "octopus", 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: "pacific", 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: "elector-pinging", 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: "quincy", 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: "reef", 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: "squid" 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: "optional": [] 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.877 INFO:tasks.workunit.client.0.trial155.stdout: "mons": [ 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: "rank": 0, 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: "name": "a", 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: "public_addrs": { 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:7109", 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 0 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.878 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:7109/0", 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: "public_addr": "127.0.0.1:7109/0", 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: "priority": 0, 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 0, 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: "crush_location": "{}" 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: "quorum": [ 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: 0 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap": { 2026-02-17T12:50:48.879 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 13, 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "fsid": "af5bea88-7d02-4f39-9b2e-26dff0e1f9f6", 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "created": "2026-02-17T12:34:06.870921+0000", 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "modified": "2026-02-17T12:49:16.898393+0000", 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "last_up_change": "2026-02-17T12:49:16.898393+0000", 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "last_in_change": "2026-02-17T12:34:07.179206+0000", 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "flags_num": 5799936, 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "flags_set": [ 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "pglog_hardlimit", 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "purged_snapdirs", 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "recovery_deletes", 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: "sortbitwise" 2026-02-17T12:50:48.880 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "crush_version": 3, 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_snapshot": "", 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "pool_max": 1, 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "max_osd": 1, 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "require_min_compat_client": "luminous", 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "min_compat_client": "jewel", 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "require_osd_release": "squid", 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "allow_crimson": false, 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: "pools": [ 2026-02-17T12:50:48.881 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "pool": 1, 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "pool_name": "rbd", 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "create_time": "2026-02-17T12:34:17.069310+0000", 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "flags": 8193, 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "type": 1, 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "size": 1, 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "min_size": 1, 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "crush_rule": 0, 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_count": 0, 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_target": 0, 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T12:50:48.882 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "is_stretch_pool": false, 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "object_hash": 2, 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "pg_autoscale_mode": "off", 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "pg_num": 4, 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "pg_placement_num": 4, 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "pg_placement_num_target": 4, 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "pg_num_target": 4, 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "pg_num_pending": 4, 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "last_pg_merge_meta": { 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "source_pgid": "0.0", 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "ready_epoch": 0, 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "last_epoch_started": 0, 2026-02-17T12:50:48.883 INFO:tasks.workunit.client.0.trial155.stdout: "last_epoch_clean": 0, 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "source_version": "0'0", 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "target_version": "0'0" 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "last_change": "11", 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "last_force_op_resend": "0", 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "auid": 0, 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "snap_mode": "selfmanaged", 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "snap_seq": 2, 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "snap_epoch": 11, 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "pool_snaps": [], 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "removed_snaps": "[]", 2026-02-17T12:50:48.884 INFO:tasks.workunit.client.0.trial155.stdout: "quota_max_bytes": 0, 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "quota_max_objects": 0, 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "tiers": [], 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "tier_of": -1, 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "read_tier": -1, 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "write_tier": -1, 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "cache_mode": "none", 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "target_max_bytes": 0, 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "target_max_objects": 0, 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T12:50:48.885 INFO:tasks.workunit.client.0.trial155.stdout: "cache_min_flush_age": 0, 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "cache_min_evict_age": 0, 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "erasure_code_profile": "", 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_params": { 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "type": "none" 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_period": 0, 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_count": 0, 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "use_gmt_hitset": true, 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "min_read_recency_for_promote": 0, 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "min_write_recency_for_promote": 0, 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_search_last_n": 0, 2026-02-17T12:50:48.886 INFO:tasks.workunit.client.0.trial155.stdout: "grade_table": [], 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: "stripe_width": 0, 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: "expected_num_objects": 0, 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: "fast_read": false, 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: "options": {}, 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: "application_metadata": { 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: "rbd": {} 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: "osds": [ 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.887 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "uuid": "f82780e6-fc85-475c-8969-1fbea8e37209", 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "up": 0, 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "in": 1, 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 1, 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "primary_affinity": 1, 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "last_clean_begin": 0, 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "last_clean_end": 0, 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "up_from": 5, 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "up_thru": 6, 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "down_at": 13, 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "lost_at": 0, 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "public_addrs": { 2026-02-17T12:50:48.888 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6802", 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2949332662 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6803", 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2949332662 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.889 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_addrs": { 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6804", 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2949332662 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6805", 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2949332662 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.890 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_back_addrs": { 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6808", 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2949332662 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6809", 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2949332662 2026-02-17T12:50:48.891 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_front_addrs": { 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6806", 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2949332662 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6807", 2026-02-17T12:50:48.892 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2949332662 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: "public_addr": "127.0.0.1:6803/2949332662", 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_addr": "127.0.0.1:6805/2949332662", 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_back_addr": "127.0.0.1:6809/2949332662", 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_front_addr": "127.0.0.1:6807/2949332662", 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: "state": [ 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: "exists" 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.893 INFO:tasks.workunit.client.0.trial155.stdout: "osd_xinfo": [ 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: "down_stamp": "2026-02-17T12:49:16.898393+0000", 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: "laggy_probability": 0, 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: "laggy_interval": 0, 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: "features": 4540701547738038271, 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: "old_weight": 0, 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: "dead_epoch": 0 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.894 INFO:tasks.workunit.client.0.trial155.stdout: "pg_upmap": [], 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "pg_upmap_items": [], 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "pg_upmap_primaries": [], 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "pg_temp": [], 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "primary_temp": [], 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "blocklist": {}, 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "range_blocklist": {}, 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "erasure_code_profiles": { 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "default": { 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "k": "2", 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "m": "2", 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "plugin": "jerasure", 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: "technique": "reed_sol_van" 2026-02-17T12:50:48.895 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: "removed_snaps_queue": [], 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: "new_removed_snaps": [], 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: "new_purged_snaps": [], 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: "crush_node_flags": {}, 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: "device_class_flags": {}, 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode": { 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode_enabled": false, 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_bucket_count": 0, 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: "degraded_stretch_mode": 0, 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: "recovering_stretch_mode": 0, 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode_bucket": 0 2026-02-17T12:50:48.896 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: "osd_metadata": [ 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: "arch": "x86_64", 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: "back_addr": "[v2:127.0.0.1:6804/2949332662,v1:127.0.0.1:6805/2949332662]", 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: "back_iface": "", 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs": "1", 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs_dedicated_db": "0", 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs_single_shared_device": "1", 2026-02-17T12:50:48.897 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_allocator": "hybrid", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_path": "td/ceph-helpers/0/block", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T12:50:48.898 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_release": "squid", 2026-02-17T12:50:48.899 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_version": "ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable)", 2026-02-17T12:50:48.899 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_version_short": "19.2.3-675-g3c96dfb3", 2026-02-17T12:50:48.899 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_version_when_created": "ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable)", 2026-02-17T12:50:48.899 INFO:tasks.workunit.client.0.trial155.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T12:50:48.899 INFO:tasks.workunit.client.0.trial155.stdout: "created_at": "2026-02-17T12:34:09.605490Z", 2026-02-17T12:50:48.899 INFO:tasks.workunit.client.0.trial155.stdout: "default_device_class": "ssd", 2026-02-17T12:50:48.899 INFO:tasks.workunit.client.0.trial155.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD5F82", 2026-02-17T12:50:48.899 INFO:tasks.workunit.client.0.trial155.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T12:50:48.899 INFO:tasks.workunit.client.0.trial155.stdout: "devices": "nvme0n1", 2026-02-17T12:50:48.900 INFO:tasks.workunit.client.0.trial155.stdout: "distro": "centos", 2026-02-17T12:50:48.900 INFO:tasks.workunit.client.0.trial155.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T12:50:48.900 INFO:tasks.workunit.client.0.trial155.stdout: "distro_version": "9", 2026-02-17T12:50:48.900 INFO:tasks.workunit.client.0.trial155.stdout: "front_addr": "[v2:127.0.0.1:6802/2949332662,v1:127.0.0.1:6803/2949332662]", 2026-02-17T12:50:48.900 INFO:tasks.workunit.client.0.trial155.stdout: "front_iface": "", 2026-02-17T12:50:48.900 INFO:tasks.workunit.client.0.trial155.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/2949332662,v1:127.0.0.1:6809/2949332662]", 2026-02-17T12:50:48.900 INFO:tasks.workunit.client.0.trial155.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/2949332662,v1:127.0.0.1:6807/2949332662]", 2026-02-17T12:50:48.901 INFO:tasks.workunit.client.0.trial155.stdout: "hostname": "trial155", 2026-02-17T12:50:48.901 INFO:tasks.workunit.client.0.trial155.stdout: "journal_rotational": "0", 2026-02-17T12:50:48.901 INFO:tasks.workunit.client.0.trial155.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T12:50:48.901 INFO:tasks.workunit.client.0.trial155.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T12:50:48.901 INFO:tasks.workunit.client.0.trial155.stdout: "mem_swap_kb": "8388604", 2026-02-17T12:50:48.901 INFO:tasks.workunit.client.0.trial155.stdout: "mem_total_kb": "130438932", 2026-02-17T12:50:48.901 INFO:tasks.workunit.client.0.trial155.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T12:50:48.901 INFO:tasks.workunit.client.0.trial155.stdout: "objectstore_numa_node": "0", 2026-02-17T12:50:48.901 INFO:tasks.workunit.client.0.trial155.stdout: "objectstore_numa_nodes": "0", 2026-02-17T12:50:48.901 INFO:tasks.workunit.client.0.trial155.stdout: "os": "Linux", 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: "osd_data": "td/ceph-helpers/0", 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: "osd_objectstore": "bluestore", 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: "osdspec_affinity": "", 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: "rotational": "0" 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap_clean_epochs": { 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: "min_last_epoch_clean": 0, 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: "last_epoch_clean": { 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: "per_pool": [] 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: "osd_epochs": [] 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.902 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap_first_committed": 1, 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap_last_committed": 13, 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: "crushmap": { 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: "devices": [ 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: "name": "osd.0", 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: "class": "ssd" 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: "types": [ 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 0, 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: "name": "osd" 2026-02-17T12:50:48.903 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 1, 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: "name": "host" 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 2, 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: "name": "chassis" 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 3, 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: "name": "rack" 2026-02-17T12:50:48.904 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 4, 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: "name": "row" 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 5, 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: "name": "pdu" 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 6, 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: "name": "pod" 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 7, 2026-02-17T12:50:48.905 INFO:tasks.workunit.client.0.trial155.stdout: "name": "room" 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 8, 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: "name": "datacenter" 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 9, 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: "name": "zone" 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 10, 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: "name": "region" 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.906 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 11, 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: "name": "root" 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: "buckets": [ 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: "id": -1, 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: "name": "default", 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 11, 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "root", 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:50:48.907 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "id": -3, 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "id": -2, 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "name": "default~ssd", 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 11, 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "root", 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.908 INFO:tasks.workunit.client.0.trial155.stdout: "id": -4, 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: "id": -3, 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: "name": "trial155", 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 1, 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "host", 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.909 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: "id": -4, 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: "name": "trial155~ssd", 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 1, 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "host", 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.910 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: "rules": [ 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: "rule_id": 0, 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: "rule_name": "replicated_rule", 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: "type": 1, 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: "steps": [ 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: "op": "take", 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: "item": -1, 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: "item_name": "default" 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.911 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: "op": "choose_firstn", 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: "num": 0, 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: "type": "osd" 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: "op": "emit" 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: "tunables": { 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: "choose_local_tries": 0, 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: "choose_local_fallback_tries": 0, 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: "choose_total_tries": 50, 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: "chooseleaf_descend_once": 1, 2026-02-17T12:50:48.912 INFO:tasks.workunit.client.0.trial155.stdout: "chooseleaf_vary_r": 1, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "chooseleaf_stable": 1, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "msr_descents": 100, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "msr_collision_tries": 100, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "straw_calc_version": 1, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "allowed_bucket_algs": 54, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "profile": "jewel", 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "optimal_tunables": 1, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "legacy_tunables": 0, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "minimum_required_version": "jewel", 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables": 1, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables2": 1, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "has_v2_rules": 0, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables3": 1, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "has_v3_rules": 0, 2026-02-17T12:50:48.913 INFO:tasks.workunit.client.0.trial155.stdout: "has_v4_buckets": 1, 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables5": 1, 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "has_v5_rules": 0, 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "has_msr_rules": 0 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "choose_args": {} 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "fsmap": { 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 1, 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "btime": "2026-02-17T12:34:06:870760+0000", 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "default_fscid": -1, 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "compat": { 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "compat": {}, 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "ro_compat": {}, 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "incompat": { 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "feature_1": "base v0.20", 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "feature_2": "client writeable ranges", 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "feature_4": "dir inode in separate object", 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T12:50:48.914 INFO:tasks.workunit.client.0.trial155.stdout: "feature_8": "no anchor table", 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "feature_9": "file layout v2", 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "feature_10": "snaprealm v2", 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "feature_11": "minor log segments", 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "feature_flags": { 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "enable_multiple": true, 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "ever_enabled_multiple": true 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "standbys": [], 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "filesystems": [] 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "mdsmap_first_committed": 1, 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "mdsmap_last_committed": 1, 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "auth": { 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "first_committed": 1, 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "last_committed": 3, 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "num_secrets": 1 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.915 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg": 4, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_active": 4, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_unknown": 0, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_osd": 1, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "pool_sum": { 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "stat_sum": { 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes": 19, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects": 2, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_clones": 0, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_copies": 2, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing": 0, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_degraded": 0, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_misplaced": 0, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_unfound": 0, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_dirty": 2, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_whiteouts": 0, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_read": 0, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_read_kb": 0, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_write": 2, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_write_kb": 2, 2026-02-17T12:50:48.916 INFO:tasks.workunit.client.0.trial155.stdout: "num_scrub_errors": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_deep_scrub_errors": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_recovered": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_recovered": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_keys_recovered": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_omap": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_kb": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_kb": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_promote": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_high": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_low": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_some": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_full": 0, 2026-02-17T12:50:48.917 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_pinned": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "num_legacy_snapsets": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "num_large_omap_objects": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_manifest": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_bytes": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_keys": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_repaired": 0 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "store_stats": { 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "total": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "available": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 0, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 0 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "log_size": 3, 2026-02-17T12:50:48.918 INFO:tasks.workunit.client.0.trial155.stdout: "ondisk_log_size": 3, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "up": 4, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "acting": 4, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "num_store_stats": 0 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "osd_sum": { 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "up_from": 0, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "seq": 0, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "num_pgs": 4, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "num_osds": 1, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_osds": 1, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_omap_osds": 1, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "kb": 104857600, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used": 27068, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_data": 108, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_omap": 1, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_meta": 26942, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "kb_avail": 104830532, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "statfs": { 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "total": 107374182400, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "available": 107346464768, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:50:48.919 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 110592, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 23277, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 1593, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 27589063 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "hb_peers": [], 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "snap_trim_queue_len": 0, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "num_snap_trimming": 0, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "num_shards_repaired": 0, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "op_queue_age_hist": { 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "histogram": [], 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "upper_bound": 1 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "perf_stat": { 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ms": 0, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ms": 0, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ns": 0, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ns": 0 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.920 INFO:tasks.workunit.client.0.trial155.stdout: "alerts": [], 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "network_ping_times": [] 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "osd_sum_by_class": { 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "ssd": { 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "up_from": 0, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "seq": 0, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "num_pgs": 4, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "num_osds": 1, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_osds": 1, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_omap_osds": 1, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "kb": 104857600, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used": 27068, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_data": 108, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_omap": 1, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_meta": 26942, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "kb_avail": 104830532, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "statfs": { 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "total": 107374182400, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "available": 107346464768, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 110592, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 23277, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:50:48.921 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 1593, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 27589063 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "hb_peers": [], 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "snap_trim_queue_len": 0, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "num_snap_trimming": 0, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "num_shards_repaired": 0, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "op_queue_age_hist": { 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "histogram": [], 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "upper_bound": 1 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "perf_stat": { 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ms": 0, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ms": 0, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ns": 0, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ns": 0 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "alerts": [], 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "network_ping_times": [] 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.922 INFO:tasks.workunit.client.0.trial155.stdout: "pool_stats": [ 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "poolid": 1, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg": 4, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "stat_sum": { 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes": 19, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects": 2, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_clones": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_copies": 2, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_degraded": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_misplaced": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_unfound": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_dirty": 2, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_whiteouts": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_read": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_read_kb": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_write": 2, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_write_kb": 2, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_scrub_errors": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_deep_scrub_errors": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_recovered": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_recovered": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_keys_recovered": 0, 2026-02-17T12:50:48.923 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_omap": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_kb": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_kb": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_promote": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_high": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_low": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_some": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_full": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_pinned": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_legacy_snapsets": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_large_omap_objects": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_manifest": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_bytes": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_keys": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_repaired": 0 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "store_stats": { 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "total": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "available": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 4096, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 19, 2026-02-17T12:50:48.924 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 0, 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 0 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "log_size": 3, 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "ondisk_log_size": 3, 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "up": 4, 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "acting": 4, 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "num_store_stats": 1 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "osd_stats": [ 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "seq": 21474836487 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_by_state": [ 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "state": "stale+active+clean", 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "num": 4 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_by_osd": [ 2026-02-17T12:50:48.925 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "num_primary_pg": 4, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "num_acting_pg": 4, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "num_up_not_acting_pg": 0 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "purged_snaps": [ 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "pool": 1, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "purged_snaps": {} 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "servicemap": { 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 4, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "modified": "2026-02-17T12:50:11.125017+0000", 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "services": {} 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "mgrstat_first_committed": 252, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "mgrstat_last_committed": 498, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "logm_first_committed": 1, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "logm_last_committed": 548, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "paxos": { 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "first_committed": 503, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "last_committed": 1071, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "last_pn": 0, 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: "accepted_pn": 0 2026-02-17T12:50:48.926 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:50:48.927 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:50:48.927 INFO:tasks.workunit.client.0.trial155.stderr:report 437581062 2026-02-17T12:50:48.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1722: wait_for_pg_clean: echo 'PG 1.0 is not clean after 31 iterations' 2026-02-17T12:50:48.927 INFO:tasks.workunit.client.0.trial155.stdout:PG 1.0 is not clean after 31 iterations 2026-02-17T12:50:48.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1723: wait_for_pg_clean: return 1 2026-02-17T12:50:48.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_scrub: return 1 2026-02-17T12:50:48.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1961: test_pg_scrub: teardown td/ceph-helpers 2026-02-17T12:50:48.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:50:48.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:50:48.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:50:48.928 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:50:48.928 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:50:48.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:50:48.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:50:48.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:50:48.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:50:48.978 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:50:48.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:50:48.980 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:50:48.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:50:48.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:50:48.982 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:50:48.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:50:48.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:50:48.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:50:48.984 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:50:48.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:50:48.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:50:48.985 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:50:48.995 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:50:48.995 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:50:48.996 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:50:48.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:50:48.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:50:48.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:50:48.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:50:48.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_repair td/ceph-helpers 2026-02-17T12:50:48.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1903: test_repair: local dir=td/ceph-helpers 2026-02-17T12:50:48.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1905: test_repair: setup td/ceph-helpers 2026-02-17T12:50:48.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:50:48.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:50:48.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:50:48.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:50:48.999 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:50:48.999 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:50:48.999 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:50:48.999 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:50:48.999 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:50:48.999 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:50:49.000 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:50:49.000 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:50:49.000 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:50:49.000 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:50:49.001 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:50:49.001 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:50:49.001 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:50:49.002 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:50:49.002 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:50:49.002 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:50:49.003 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:50:49.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:50:49.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:50:49.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:50:49.005 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:50:49.005 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:50:49.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:50:49.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:50:49.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:50:49.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:50:49.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:50:49.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:50:49.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:50:49.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:50:49.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:50:49.009 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:50:49.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:50:49.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:50:49.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:50:49.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1906: test_repair: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:50:49.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:50:49.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:50:49.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:50:49.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:50:49.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:50:49.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:50:49.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:50:49.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:50:49.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:50:49.031 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:50:49.031 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:50:49.031 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:50:49.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:50:49.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:50:49.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:50:49.060 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:50:49.060 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:50:49.060 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:50:49.060 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:50:49.060 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:50:49.060 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:50:49.060 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:50:49.061 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:50:49.061 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:50:49.061 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:50:49.061 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:50:49.061 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:50:49.061 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:50:49.061 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:50:49.104 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:50:49.104 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:50:49.105 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:50:49.105 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:50:49.105 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:50:49.105 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:50:49.105 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:50:49.105 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:50:49.106 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:50:49.106 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:50:49.106 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:50:49.106 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:50:49.106 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:50:49.107 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:50:49.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1907: test_repair: run_mgr td/ceph-helpers x 2026-02-17T12:50:49.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:50:49.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:50:49.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:50:49.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:50:49.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:50:49.151 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:50:49.251 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:50:49.251 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:50:49.251 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:50:49.251 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:50:49.252 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:50:49.252 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:50:49.252 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:50:49.252 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:50:49.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:50:49.273 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1908: test_repair: run_osd td/ceph-helpers 0 2026-02-17T12:50:49.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:50:49.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:50:49.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:50:49.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:50:49.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:50:49.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:50:49.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:50:49.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:50:49.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:50:49.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:50:49.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:50:49.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:50:49.276 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:50:49.277 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=109a2a14-a0b7-4090-91d3-234d452febb9 2026-02-17T12:50:49.277 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 109a2a14-a0b7-4090-91d3-234d452febb9' 2026-02-17T12:50:49.277 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 109a2a14-a0b7-4090-91d3-234d452febb9 2026-02-17T12:50:49.278 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:50:49.285 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQApZJRpH+XzEBAAJT1ttUP2hqFvD9jbE0G/HQ== 2026-02-17T12:50:49.286 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQApZJRpH+XzEBAAJT1ttUP2hqFvD9jbE0G/HQ=="}' 2026-02-17T12:50:49.286 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 109a2a14-a0b7-4090-91d3-234d452febb9 -i td/ceph-helpers/0/new.json 2026-02-17T12:50:49.388 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:50:49.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:50:49.396 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQApZJRpH+XzEBAAJT1ttUP2hqFvD9jbE0G/HQ== --osd-uuid 109a2a14-a0b7-4090-91d3-234d452febb9 2026-02-17T12:50:49.413 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:50:49.412+0000 7ff651c2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:50:49.414 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:50:49.413+0000 7ff651c2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:50:49.415 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:50:49.414+0000 7ff651c2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:50:49.416 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:50:49.415+0000 7ff651c2c780 -1 bdev(0x56329dda3c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:50:49.416 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:50:49.415+0000 7ff651c2c780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:50:52.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:50:52.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:50:52.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:50:52.301 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:50:52.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:50:52.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:50:52.562 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:50:52.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:50:52.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:50:52.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:50:52.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:50:52.578 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:50:52.577+0000 7fce4659c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:50:52.579 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:50:52.578+0000 7fce4659c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:50:52.580 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:50:52.579+0000 7fce4659c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:50:52.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:50:52.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:50:52.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:50:52.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:50:52.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:50:52.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:50:52.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:50:52.750 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:50:52.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:50:52.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:50:52.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:50:53.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:50:53.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:50:53.938 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:50:53.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:50:53.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:50:53.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:50:54.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:50:54.162 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:50:54.160+0000 7fce4659c780 -1 Falling back to public interface 2026-02-17T12:50:55.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:50:55.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:50:55.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:50:55.131 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:50:55.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:50:55.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:50:55.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:50:56.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:50:56.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:50:56.323 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:50:56.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:50:56.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:50:56.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:50:56.510 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:50:56.849 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:50:56.848+0000 7fce4659c780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:50:57.512 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:50:57.512 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:50:57.512 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:50:57.513 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:50:57.513 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:50:57.513 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:50:57.709 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/161208973,v1:127.0.0.1:6803/161208973] [v2:127.0.0.1:6804/161208973,v1:127.0.0.1:6805/161208973] exists,up 109a2a14-a0b7-4090-91d3-234d452febb9 2026-02-17T12:50:57.710 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:50:57.710 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:50:57.710 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:50:57.710 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1909: test_repair: create_rbd_pool 2026-02-17T12:50:57.710 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:50:57.894 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:50:57.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:50:57.902 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:50:58.156 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:50:58.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:50:59.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:50:59.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1910: test_repair: wait_for_clean 2026-02-17T12:50:59.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:50:59.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:50:59.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:50:59.446 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:50:59.446 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:50:59.446 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:50:59.446 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:50:59.446 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:50:59.446 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:50:59.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:50:59.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:50:59.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:50:59.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:50:59.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:50:59.529 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:50:59.721 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:50:59.721 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:50:59.722 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:50:59.722 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:50:59.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836483 2026-02-17T12:50:59.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836483 2026-02-17T12:50:59.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T12:50:59.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:50:59.784 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836483 2026-02-17T12:50:59.784 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:50:59.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:50:59.785 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836483 2026-02-17T12:50:59.785 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:50:59.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836483 2026-02-17T12:50:59.787 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836483 2026-02-17T12:50:59.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T12:50:59.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:50:59.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:50:59.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:51:00.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:51:00.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:51:01.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:51:01.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:51:02.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:51:02.169 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:51:02.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T12:51:02.364 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:51:02.364 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:51:02.365 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:51:02.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:51:02.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:51:02.616 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:51:02.616 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:51:02.616 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:51:02.616 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:51:02.617 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:51:02.617 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:51:02.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:51:02.802 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:51:02.803 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:51:02.803 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:51:03.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:51:03.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:51:03.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:51:03.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1911: test_repair: repair 1.0 2026-02-17T12:51:03.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1896: repair: local pgid=1.0 2026-02-17T12:51:03.059 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1897: repair: get_last_scrub_stamp 1.0 2026-02-17T12:51:03.059 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:51:03.059 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:51:03.059 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:51:03.060 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:51:03.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1897: repair: local last_scrub=2026-02-17T12:50:58.106505+0000 2026-02-17T12:51:03.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1898: repair: ceph pg repair 1.0 2026-02-17T12:51:03.424 INFO:tasks.workunit.client.0.trial155.stderr:instructing pg 1.0 on osd.0 to repair 2026-02-17T12:51:03.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1899: repair: wait_for_scrub 1.0 2026-02-17T12:50:58.106505+0000 2026-02-17T12:51:03.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: wait_for_scrub: local pgid=1.0 2026-02-17T12:51:03.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: wait_for_scrub: local last_scrub=2026-02-17T12:50:58.106505+0000 2026-02-17T12:51:03.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T12:51:03.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i=0 )) 2026-02-17T12:51:03.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:51:03.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:51:03.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:51:03.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:51:03.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:51:03.433 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:51:03.618 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:50:58.106505+0000 '>' 2026-02-17T12:50:58.106505+0000 2026-02-17T12:51:03.618 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:51:04.619 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:51:04.619 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:51:04.620 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:51:04.620 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:51:04.621 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:51:04.621 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:51:04.621 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:51:04.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:50:58.106505+0000 '>' 2026-02-17T12:50:58.106505+0000 2026-02-17T12:51:04.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:51:05.806 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:51:05.807 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:51:05.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:51:05.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:51:05.807 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:51:05.808 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:51:05.808 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:51:05.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:50:58.106505+0000 '>' 2026-02-17T12:50:58.106505+0000 2026-02-17T12:51:05.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:51:06.992 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:51:06.992 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:51:06.993 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:51:06.993 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:51:06.993 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:51:06.993 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:51:06.993 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:51:07.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:50:58.106505+0000 '>' 2026-02-17T12:50:58.106505+0000 2026-02-17T12:51:07.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:51:08.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:51:08.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:51:08.188 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:51:08.188 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:51:08.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:51:08.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:51:08.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:51:08.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:50:58.106505+0000 '>' 2026-02-17T12:50:58.106505+0000 2026-02-17T12:51:08.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:51:09.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:51:09.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:51:09.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:51:09.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:51:09.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:51:09.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:51:09.377 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:51:09.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:51:03.996442+0000 '>' 2026-02-17T12:50:58.106505+0000 2026-02-17T12:51:09.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: wait_for_scrub: return 0 2026-02-17T12:51:09.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1912: test_repair: kill_daemons td/ceph-helpers KILL osd 2026-02-17T12:51:09.563 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:51:09.563 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:51:09.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:51:09.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:51:09.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:51:09.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:51:09.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1913: test_repair: TIMEOUT=1 2026-02-17T12:51:09.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1913: test_repair: repair 1.0 2026-02-17T12:51:09.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1896: repair: local pgid=1.0 2026-02-17T12:51:09.670 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1897: repair: get_last_scrub_stamp 1.0 2026-02-17T12:51:09.670 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:51:09.670 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:51:09.671 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:51:09.671 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:51:09.855 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1897: repair: local last_scrub=2026-02-17T12:51:03.996442+0000 2026-02-17T12:51:09.855 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1898: repair: ceph pg repair 1.0 2026-02-17T12:51:10.038 INFO:tasks.workunit.client.0.trial155.stderr:instructing pg 1.0 on osd.0 to repair 2026-02-17T12:51:10.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1899: repair: wait_for_scrub 1.0 2026-02-17T12:51:03.996442+0000 2026-02-17T12:51:10.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: wait_for_scrub: local pgid=1.0 2026-02-17T12:51:10.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: wait_for_scrub: local last_scrub=2026-02-17T12:51:03.996442+0000 2026-02-17T12:51:10.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T12:51:10.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i=0 )) 2026-02-17T12:51:10.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 1 )) 2026-02-17T12:51:10.048 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:51:10.048 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:51:10.048 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:51:10.048 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:51:10.048 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:51:10.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:51:03.996442+0000 '>' 2026-02-17T12:51:03.996442+0000 2026-02-17T12:51:10.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:51:11.231 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:51:11.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 1 )) 2026-02-17T12:51:11.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: wait_for_scrub: return 1 2026-02-17T12:51:11.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1914: test_repair: teardown td/ceph-helpers 2026-02-17T12:51:11.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:51:11.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:51:11.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:51:11.232 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:51:11.232 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:51:11.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:51:11.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:51:11.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:51:11.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:51:11.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:51:11.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:51:11.340 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:51:11.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:51:11.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:51:11.342 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:51:11.343 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:51:11.343 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:51:11.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:51:11.344 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:51:11.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:51:11.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:51:11.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:51:11.350 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:51:11.350 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:11.350 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:11.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:51:11.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:51:11.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:51:11.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:51:11.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_run_in_background td/ceph-helpers 2026-02-17T12:51:11.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: test_run_in_background: local pids 2026-02-17T12:51:11.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2206: test_run_in_background: run_in_background pids sleep 1 2026-02-17T12:51:11.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2190: run_in_background: local pid_variable=pids 2026-02-17T12:51:11.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2191: run_in_background: shift 2026-02-17T12:51:11.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: eval 'pids+=" 141397"' 2026-02-17T12:51:11.353 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: pids+=' 141397' 2026-02-17T12:51:11.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: test_run_in_background: run_in_background pids sleep 1 2026-02-17T12:51:11.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2190: run_in_background: local pid_variable=pids 2026-02-17T12:51:11.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2191: run_in_background: shift 2026-02-17T12:51:11.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: eval 'pids+=" 141398"' 2026-02-17T12:51:11.354 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: pids+=' 141398' 2026-02-17T12:51:11.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: sleep 1 2026-02-17T12:51:11.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: sed 's/^/141400: /' 2026-02-17T12:51:11.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: sleep 1 2026-02-17T12:51:11.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: sed 's/^/141403: /' 2026-02-17T12:51:11.354 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: test_run_in_background: echo 141397 141398 2026-02-17T12:51:11.354 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: test_run_in_background: wc -w 2026-02-17T12:51:11.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: test_run_in_background: test 2 = 2 2026-02-17T12:51:11.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: test_run_in_background: wait 141397 141398 2026-02-17T12:51:12.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: return 0 2026-02-17T12:51:12.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: return 0 2026-02-17T12:51:12.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_run_mon td/ceph-helpers 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:495: test_run_mon: local dir=td/ceph-helpers 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:497: test_run_mon: setup td/ceph-helpers 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:51:12.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:51:12.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:51:12.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:51:12.357 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:51:12.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:51:12.358 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:51:12.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:51:12.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:51:12.359 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:51:12.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:51:12.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:51:12.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:51:12.361 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:51:12.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:51:12.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:51:12.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:51:12.363 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:51:12.363 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:12.363 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:12.364 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:51:12.364 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:51:12.364 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:51:12.364 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:51:12.366 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:51:12.366 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:12.366 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:12.366 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:51:12.368 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:51:12.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:51:12.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:51:12.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:51:12.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:499: test_run_mon: run_mon td/ceph-helpers a 2026-02-17T12:51:12.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:51:12.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:51:12.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:51:12.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:51:12.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:51:12.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-17T12:51:12.388 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:51:12.388 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:51:12.388 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:51:12.388 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:51:12.388 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:12.388 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:12.388 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:51:12.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:51:12.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:51:12.415 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:51:12.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:51:12.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:51:12.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:51:12.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:51:12.416 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:51:12.416 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:51:12.416 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:51:12.416 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:51:12.416 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:12.416 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:12.416 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:51:12.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:51:12.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:51:12.460 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:51:12.460 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:51:12.460 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:51:12.460 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:51:12.460 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:51:12.460 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:51:12.460 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:51:12.460 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:51:12.461 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:51:12.462 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:12.462 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:12.462 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:51:12.462 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:51:12.462 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:51:12.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:500: test_run_mon: ceph mon dump 2026-02-17T12:51:12.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:500: test_run_mon: grep mon.a 2026-02-17T12:51:12.598 INFO:tasks.workunit.client.0.trial155.stderr:dumped monmap epoch 1 2026-02-17T12:51:12.604 INFO:tasks.workunit.client.0.trial155.stdout:0: v2:127.0.0.1:7109/0 mon.a 2026-02-17T12:51:12.604 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:501: test_run_mon: kill_daemons td/ceph-helpers 2026-02-17T12:51:12.605 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:51:12.605 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:51:12.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:51:12.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:51:12.606 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:51:12.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:51:12.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:503: test_run_mon: run_mon td/ceph-helpers a --osd_pool_default_size=3 2026-02-17T12:51:12.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:51:12.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:51:12.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:51:12.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:51:12.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:51:12.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=3 2026-02-17T12:51:12.928 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:12.926+0000 7fb202c0cd80 -1 'td/ceph-helpers/a' already exists and is not empty: monitor may already exist 2026-02-17T12:51:12.930 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:51:12.930 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:51:12.930 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:51:12.931 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:51:12.931 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:12.931 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:12.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:51:12.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-17T12:51:12.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:51:12.960 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:51:12.960 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:51:12.960 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:51:12.960 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:51:12.960 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:51:12.960 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:51:12.960 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:51:12.960 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:51:12.961 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:51:12.961 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:12.962 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:12.962 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:51:12.962 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:51:12.962 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:51:13.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:51:13.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:51:13.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:51:13.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:51:13.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:51:13.008 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:51:13.009 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:51:13.009 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:51:13.010 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:51:13.010 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:13.010 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:13.010 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:51:13.010 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:51:13.010 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:51:13.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:504: test_run_mon: run_osd td/ceph-helpers 0 2026-02-17T12:51:13.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:51:13.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:51:13.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:51:13.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:51:13.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:51:13.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:51:13.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:51:13.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:51:13.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:51:13.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:51:13.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:51:13.059 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:51:13.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2a0a2958-23eb-4844-a229-39ad35c6985b 2026-02-17T12:51:13.060 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 2a0a2958-23eb-4844-a229-39ad35c6985b 2026-02-17T12:51:13.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 2a0a2958-23eb-4844-a229-39ad35c6985b' 2026-02-17T12:51:13.061 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:51:13.068 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBBZJRp7gEEBBAAOkvnjjE4lAruQtYHwGF7CQ== 2026-02-17T12:51:13.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBBZJRp7gEEBBAAOkvnjjE4lAruQtYHwGF7CQ=="}' 2026-02-17T12:51:13.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2a0a2958-23eb-4844-a229-39ad35c6985b -i td/ceph-helpers/0/new.json 2026-02-17T12:51:13.170 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:51:13.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:51:13.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBBZJRp7gEEBBAAOkvnjjE4lAruQtYHwGF7CQ== --osd-uuid 2a0a2958-23eb-4844-a229-39ad35c6985b 2026-02-17T12:51:13.195 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:13.193+0000 7f2656618780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:13.196 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:13.195+0000 7f2656618780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:13.197 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:13.196+0000 7f2656618780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:13.198 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:13.196+0000 7f2656618780 -1 bdev(0x55f50890bc00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:51:13.198 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:13.196+0000 7f2656618780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:51:15.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:51:15.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:51:15.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:51:15.311 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:51:15.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:51:15.415 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:51:15.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:51:15.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:51:15.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:51:15.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:51:15.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:51:15.433 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:15.431+0000 7f1918c1a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:15.434 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:15.432+0000 7f1918c1a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:15.435 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:15.433+0000 7f1918c1a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:15.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:51:15.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:51:15.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:51:15.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:51:15.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:51:15.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:15.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:51:15.516 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:51:15.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:15.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:51:15.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:16.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:16.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:16.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:51:16.613 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:51:16.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:16.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:51:16.712 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:17.016 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:17.015+0000 7f1918c1a780 -1 Falling back to public interface 2026-02-17T12:51:17.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:17.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:17.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:51:17.714 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:51:17.715 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:17.715 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:51:17.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:18.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:18.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:18.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:51:18.813 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:51:18.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:18.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:51:18.906 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:19.713 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:19.712+0000 7f1918c1a780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:51:19.907 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:19.907 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:19.908 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:51:19.908 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:51:19.909 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:19.909 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:51:20.016 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:21.018 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:21.018 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:21.018 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:51:21.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:51:21.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:21.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:51:21.118 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2217116572,v1:127.0.0.1:6801/2217116572] [v2:127.0.0.1:6802/2217116572,v1:127.0.0.1:6803/2217116572] exists,up 2a0a2958-23eb-4844-a229-39ad35c6985b 2026-02-17T12:51:21.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:51:21.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:51:21.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:51:21.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:505: test_run_mon: run_osd td/ceph-helpers 1 2026-02-17T12:51:21.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:51:21.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/1 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:51:21.123 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:51:21.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:51:21.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:51:21.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:51:21.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:51:21.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:51:21.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:51:21.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:51:21.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/1 2026-02-17T12:51:21.125 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:51:21.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2a2d8061-e018-4e90-95ec-0f1710cff865 2026-02-17T12:51:21.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 2a2d8061-e018-4e90-95ec-0f1710cff865' 2026-02-17T12:51:21.126 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 2a2d8061-e018-4e90-95ec-0f1710cff865 2026-02-17T12:51:21.126 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:51:21.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBJZJRpRYTkBxAAnxSZHa8yyRu5mHL22FO5wA== 2026-02-17T12:51:21.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBJZJRpRYTkBxAAnxSZHa8yyRu5mHL22FO5wA=="}' 2026-02-17T12:51:21.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2a2d8061-e018-4e90-95ec-0f1710cff865 -i td/ceph-helpers/1/new.json 2026-02-17T12:51:21.235 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:51:21.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/1/new.json 2026-02-17T12:51:21.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBJZJRpRYTkBxAAnxSZHa8yyRu5mHL22FO5wA== --osd-uuid 2a2d8061-e018-4e90-95ec-0f1710cff865 2026-02-17T12:51:21.259 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:21.258+0000 7f8a9b59c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:21.261 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:21.260+0000 7f8a9b59c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:21.262 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:21.260+0000 7f8a9b59c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:21.262 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:21.261+0000 7f8a9b59c780 -1 bdev(0x56490ac0dc00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:51:21.262 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:21.261+0000 7f8a9b59c780 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-17T12:51:23.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-17T12:51:23.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:51:23.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:51:23.630 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:51:23.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:51:23.735 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:51:23.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:51:23.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:51:23.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:51:23.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:51:23.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:51:23.752 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:23.751+0000 7f0e7654f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:23.753 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:23.752+0000 7f0e7654f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:23.754 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:23.753+0000 7f0e7654f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:23.833 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:51:23.833 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:51:23.834 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:51:23.834 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:51:23.834 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:51:23.834 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:23.834 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:51:23.834 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:51:23.835 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:23.835 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:51:23.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:24.934 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:24.934 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:24.934 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:51:24.935 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:51:24.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:24.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:51:25.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:25.333 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:25.332+0000 7f0e7654f780 -1 Falling back to public interface 2026-02-17T12:51:26.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:26.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:26.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:51:26.032 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:51:26.032 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:26.032 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:51:26.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:27.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:27.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:27.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:51:27.132 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:51:27.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:27.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:51:27.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:28.044 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:28.042+0000 7f0e7654f780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:51:28.231 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:28.231 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:28.231 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:51:28.231 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:51:28.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:28.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:51:28.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:29.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:29.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:29.331 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:51:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:51:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:29.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:51:29.428 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/3657221729,v1:127.0.0.1:6809/3657221729] [v2:127.0.0.1:6810/3657221729,v1:127.0.0.1:6811/3657221729] exists,up 2a2d8061-e018-4e90-95ec-0f1710cff865 2026-02-17T12:51:29.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:51:29.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:51:29.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:51:29.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:506: test_run_mon: run_osd td/ceph-helpers 2 2026-02-17T12:51:29.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:51:29.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:51:29.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:51:29.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:51:29.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/2 2026-02-17T12:51:29.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:51:29.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:51:29.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:51:29.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:51:29.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2026-02-17T12:51:29.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2026-02-17T12:51:29.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:51:29.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/2 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=34bafcb8-9558-4d63-845f-74dda2b6edac 2026-02-17T12:51:29.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 34bafcb8-9558-4d63-845f-74dda2b6edac' 2026-02-17T12:51:29.436 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 34bafcb8-9558-4d63-845f-74dda2b6edac 2026-02-17T12:51:29.436 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:51:29.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBRZJRpBM90GhAAzN8mz/u89Swfb+//ZQyiTA== 2026-02-17T12:51:29.446 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBRZJRpBM90GhAAzN8mz/u89Swfb+//ZQyiTA=="}' 2026-02-17T12:51:29.446 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 34bafcb8-9558-4d63-845f-74dda2b6edac -i td/ceph-helpers/2/new.json 2026-02-17T12:51:29.547 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:51:29.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/2/new.json 2026-02-17T12:51:29.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBRZJRpBM90GhAAzN8mz/u89Swfb+//ZQyiTA== --osd-uuid 34bafcb8-9558-4d63-845f-74dda2b6edac 2026-02-17T12:51:29.571 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:29.570+0000 7fb91cc10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:29.573 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:29.572+0000 7fb91cc10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:29.574 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:29.573+0000 7fb91cc10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:29.574 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:29.573+0000 7fb91cc10780 -1 bdev(0x55fbc6561c00 td/ceph-helpers/2/block) open stat got: (1) Operation not permitted 2026-02-17T12:51:29.574 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:29.573+0000 7fb91cc10780 -1 bluestore(td/ceph-helpers/2) _read_fsid unparsable uuid 2026-02-17T12:51:31.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/2/keyring 2026-02-17T12:51:31.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:51:31.933 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:51:31.934 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:51:31.934 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:51:32.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:51:32.036 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:51:32.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:51:32.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:51:32.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:51:32.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:51:32.052 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:32.051+0000 7fbb97623780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:32.053 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:32.052+0000 7fbb97623780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:32.054 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:32.053+0000 7fbb97623780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:51:32.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:51:32.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:51:32.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:51:32.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:51:32.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:51:32.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:32.134 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:51:32.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:51:32.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:32.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:51:32.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:33.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:33.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:33.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:51:33.232 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:51:33.233 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:33.233 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:51:33.329 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:33.399 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:33.397+0000 7fbb97623780 -1 Falling back to public interface 2026-02-17T12:51:34.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:34.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:34.331 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:51:34.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:51:34.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:34.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:51:34.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:35.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:35.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:35.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:51:35.432 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:51:35.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:35.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:51:35.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:36.083 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:36.082+0000 7fbb97623780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:51:36.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:36.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:36.529 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:51:36.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:51:36.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:36.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:51:36.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:51:37.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:51:37.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:51:37.630 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:51:37.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:51:37.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:51:37.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:51:37.726 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/1847789979,v1:127.0.0.1:6817/1847789979] [v2:127.0.0.1:6818/1847789979,v1:127.0.0.1:6819/1847789979] exists,up 34bafcb8-9558-4d63-845f-74dda2b6edac 2026-02-17T12:51:37.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:51:37.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:51:37.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:51:37.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:507: test_run_mon: create_rbd_pool 2026-02-17T12:51:37.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:51:37.818 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:51:37.825 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:51:37.825 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:51:37.975 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:51:37.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:51:38.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:51:39.262 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:508: test_run_mon: ceph osd dump 2026-02-17T12:51:39.262 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:508: test_run_mon: grep 'pool 1 '\''rbd'\''' 2026-02-17T12:51:39.359 INFO:tasks.workunit.client.0.trial155.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 4 pgp_num 4 autoscale_mode off last_change 19 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2026-02-17T12:51:39.361 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:510: test_run_mon: get_asok_path mon.a 2026-02-17T12:51:39.361 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:51:39.361 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:51:39.361 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:51:39.361 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:51:39.361 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:51:39.361 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:51:39.362 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:510: test_run_mon: CEPH_ARGS= 2026-02-17T12:51:39.362 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:510: test_run_mon: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get osd_pool_default_size 2026-02-17T12:51:39.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:510: test_run_mon: local 'size={"osd_pool_default_size":"3"}' 2026-02-17T12:51:39.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:511: test_run_mon: test '{"osd_pool_default_size":"3"}' = '{"osd_pool_default_size":"3"}' 2026-02-17T12:51:39.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:513: test_run_mon: CEPH_ARGS= 2026-02-17T12:51:39.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:513: test_run_mon: ceph status 2026-02-17T12:51:59.465 INFO:tasks.workunit.client.0.trial155.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2026-02-17T12:51:59.466 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.464+0000 7efd4b4bf640 -1 failed for service _ceph-mon._tcp 2026-02-17T12:51:59.466 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.464+0000 7efd4b4bf640 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-17T12:51:59.466 INFO:tasks.workunit.client.0.trial155.stderr:[errno 2] RADOS object not found (error connecting to the cluster) 2026-02-17T12:51:59.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:514: test_run_mon: CEPH_ARGS= 2026-02-17T12:51:59.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:514: test_run_mon: ceph --conf td/ceph-helpers/ceph.conf status 2026-02-17T12:51:59.508 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.507+0000 7f6ece44d640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2026-02-17T12:51:59.509 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.507+0000 7f6ece44d640 -1 AuthRegistry(0x7f6ec8069810) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2026-02-17T12:51:59.509 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.507+0000 7f6ece44d640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2026-02-17T12:51:59.509 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.507+0000 7f6ece44d640 -1 AuthRegistry(0x7f6ece44bff0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2026-02-17T12:51:59.510 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.508+0000 7f6ece44d640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2026-02-17T12:51:59.510 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.508+0000 7f6ece44d640 -1 AuthRegistry(0x7f6ec8066db0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2026-02-17T12:51:59.510 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.508+0000 7f6ece44d640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2026-02-17T12:51:59.510 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.508+0000 7f6ece44d640 -1 AuthRegistry(0x7f6ec8106460) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2026-02-17T12:51:59.510 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.509+0000 7f6ece44d640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2026-02-17T12:51:59.510 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:51:59.509+0000 7f6ece44d640 -1 AuthRegistry(0x7f6ec8066db0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2026-02-17T12:51:59.560 INFO:tasks.workunit.client.0.trial155.stdout: cluster: 2026-02-17T12:51:59.560 INFO:tasks.workunit.client.0.trial155.stdout: id: af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 2026-02-17T12:51:59.560 INFO:tasks.workunit.client.0.trial155.stdout: health: HEALTH_OK 2026-02-17T12:51:59.560 INFO:tasks.workunit.client.0.trial155.stdout: 2026-02-17T12:51:59.560 INFO:tasks.workunit.client.0.trial155.stdout: services: 2026-02-17T12:51:59.560 INFO:tasks.workunit.client.0.trial155.stdout: mon: 1 daemons, quorum a (age 46s) 2026-02-17T12:51:59.560 INFO:tasks.workunit.client.0.trial155.stdout: mgr: no daemons active 2026-02-17T12:51:59.561 INFO:tasks.workunit.client.0.trial155.stdout: osd: 3 osds: 3 up (since 22s), 3 in (since 30s) 2026-02-17T12:51:59.561 INFO:tasks.workunit.client.0.trial155.stdout: 2026-02-17T12:51:59.561 INFO:tasks.workunit.client.0.trial155.stdout: data: 2026-02-17T12:51:59.561 INFO:tasks.workunit.client.0.trial155.stdout: pools: 0 pools, 0 pgs 2026-02-17T12:51:59.561 INFO:tasks.workunit.client.0.trial155.stdout: objects: 0 objects, 0 B 2026-02-17T12:51:59.561 INFO:tasks.workunit.client.0.trial155.stdout: usage: 0 B used, 0 B / 0 B avail 2026-02-17T12:51:59.561 INFO:tasks.workunit.client.0.trial155.stdout: pgs: 2026-02-17T12:51:59.561 INFO:tasks.workunit.client.0.trial155.stdout: 2026-02-17T12:51:59.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:516: test_run_mon: kill_daemons td/ceph-helpers 2026-02-17T12:51:59.567 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:51:59.567 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:51:59.567 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:51:59.567 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:51:59.567 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:07.881 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:07.881 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:518: test_run_mon: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:52:07.881 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:52:07.881 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:52:07.881 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:52:07.881 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:52:07.881 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:52:07.882 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:52:07.897 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:07.896+0000 7f8f23a0ed80 -1 'td/ceph-helpers/a' already exists and is not empty: monitor may already exist 2026-02-17T12:52:07.900 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:52:07.900 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:07.900 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:07.900 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:07.900 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:07.900 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:07.900 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:07.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:52:07.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:52:07.931 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:52:07.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:07.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:07.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:52:07.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:52:07.932 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:07.932 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:07.932 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:07.932 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:07.932 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:07.932 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:07.932 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:07.933 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:07.933 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:52:07.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:52:07.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:07.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:07.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:52:07.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:52:07.976 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:07.977 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:07.977 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:07.978 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:07.978 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:07.978 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:07.978 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:07.978 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:07.978 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:52:08.023 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:520: test_run_mon: get_asok_path mon.a 2026-02-17T12:52:08.023 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:08.023 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:08.023 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:08.023 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.023 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.023 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:08.024 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:520: test_run_mon: CEPH_ARGS= 2026-02-17T12:52:08.024 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:520: test_run_mon: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get osd_pool_default_size 2026-02-17T12:52:08.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:520: test_run_mon: local 'size={"osd_pool_default_size":"1"}' 2026-02-17T12:52:08.070 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:521: test_run_mon: test '{"osd_pool_default_size":"1"}' = '{"osd_pool_default_size":"1"}' 2026-02-17T12:52:08.070 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:522: test_run_mon: kill_daemons td/ceph-helpers 2026-02-17T12:52:08.070 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:08.071 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:08.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:08.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:08.071 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:08.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:08.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:524: test_run_mon: CEPH_ARGS='--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd_pool_default_size=2' 2026-02-17T12:52:08.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:524: test_run_mon: run_mon td/ceph-helpers a 2026-02-17T12:52:08.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:52:08.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:52:08.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:52:08.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:52:08.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:52:08.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-17T12:52:08.190 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:08.189+0000 7f9e76392d80 -1 'td/ceph-helpers/a' already exists and is not empty: monitor may already exist 2026-02-17T12:52:08.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:52:08.193 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:08.194 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:08.194 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:08.194 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.194 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.194 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:08.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:52:08.222 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:52:08.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:52:08.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:08.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:08.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:52:08.223 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:52:08.224 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:08.225 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:08.225 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:08.225 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:08.225 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.225 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.225 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:08.225 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:08.225 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:52:08.268 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:52:08.268 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:08.268 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:08.269 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:52:08.269 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:52:08.270 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:08.270 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:08.270 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:08.270 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:08.270 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.270 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.270 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:08.270 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:08.271 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:52:08.315 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: test_run_mon: get_asok_path mon.a 2026-02-17T12:52:08.315 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:08.315 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:08.315 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:08.315 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.315 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.315 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:08.315 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: test_run_mon: CEPH_ARGS= 2026-02-17T12:52:08.315 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: test_run_mon: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get osd_pool_default_size 2026-02-17T12:52:08.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: test_run_mon: local 'size={"osd_pool_default_size":"2"}' 2026-02-17T12:52:08.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: test_run_mon: test '{"osd_pool_default_size":"2"}' = '{"osd_pool_default_size":"2"}' 2026-02-17T12:52:08.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:529: test_run_mon: kill_daemons td/ceph-helpers 2026-02-17T12:52:08.360 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:08.360 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:08.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:08.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:08.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:08.466 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:08.466 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:531: test_run_mon: teardown td/ceph-helpers 2026-02-17T12:52:08.466 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:52:08.466 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:52:08.466 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:52:08.466 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:08.466 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:08.466 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:08.466 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:08.467 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:08.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:08.471 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:52:08.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:52:08.472 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:52:08.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:52:08.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:52:08.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:52:08.474 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:08.474 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:52:08.474 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:52:08.474 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:08.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:52:08.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:52:08.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:52:08.481 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:52:08.482 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.482 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.482 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:52:08.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:52:08.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:52:08.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:52:08.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_run_osd td/ceph-helpers 2026-02-17T12:52:08.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:745: test_run_osd: local dir=td/ceph-helpers 2026-02-17T12:52:08.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:747: test_run_osd: setup td/ceph-helpers 2026-02-17T12:52:08.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:52:08.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:52:08.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:52:08.484 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:52:08.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:52:08.485 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:08.485 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:08.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:08.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:08.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:08.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:08.486 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:52:08.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:52:08.486 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:52:08.487 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:52:08.487 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:52:08.487 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:52:08.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:08.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:52:08.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:52:08.488 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:08.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:52:08.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:52:08.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:52:08.491 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:52:08.491 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.491 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:52:08.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:52:08.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:52:08.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:52:08.494 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:52:08.494 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.494 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.494 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:52:08.495 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:52:08.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:52:08.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:52:08.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:52:08.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:749: test_run_osd: run_mon td/ceph-helpers a 2026-02-17T12:52:08.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:52:08.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:52:08.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:52:08.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:52:08.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:52:08.497 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2026-02-17T12:52:08.515 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:52:08.515 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:08.516 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:08.516 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:08.516 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.516 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.516 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:08.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T12:52:08.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:52:08.544 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:52:08.544 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:08.544 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:08.544 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:52:08.544 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:52:08.544 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:08.544 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:08.544 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:08.545 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:08.545 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.545 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.545 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:08.546 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:08.546 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:52:08.589 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:52:08.589 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:08.589 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:08.589 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:52:08.589 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:52:08.590 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:08.591 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:08.591 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:08.591 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:08.591 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.591 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.591 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:08.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:08.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:52:08.634 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:750: test_run_osd: run_mgr td/ceph-helpers x 2026-02-17T12:52:08.634 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:52:08.634 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:52:08.634 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:52:08.634 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:52:08.634 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:52:08.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:52:08.735 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:52:08.735 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:08.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:08.736 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:08.736 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.736 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:08.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:52:08.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:52:08.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:752: test_run_osd: run_osd td/ceph-helpers 0 2026-02-17T12:52:08.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:52:08.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:52:08.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:52:08.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:52:08.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:52:08.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:52:08.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:52:08.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:52:08.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:08.758 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:52:08.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:52:08.760 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:52:08.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2279070c-1cc5-4243-98e6-2d07b630a2e7 2026-02-17T12:52:08.760 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 2279070c-1cc5-4243-98e6-2d07b630a2e7 2026-02-17T12:52:08.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 2279070c-1cc5-4243-98e6-2d07b630a2e7' 2026-02-17T12:52:08.761 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:52:08.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB4ZJRpo1fMLRAAgwN086PDTsG0cPsCxV0tKg== 2026-02-17T12:52:08.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB4ZJRpo1fMLRAAgwN086PDTsG0cPsCxV0tKg=="}' 2026-02-17T12:52:08.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2279070c-1cc5-4243-98e6-2d07b630a2e7 -i td/ceph-helpers/0/new.json 2026-02-17T12:52:08.870 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:52:08.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:52:08.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB4ZJRpo1fMLRAAgwN086PDTsG0cPsCxV0tKg== --osd-uuid 2279070c-1cc5-4243-98e6-2d07b630a2e7 2026-02-17T12:52:08.895 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:08.894+0000 7fe4c861c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:08.896 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:08.895+0000 7fe4c861c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:08.897 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:08.896+0000 7fe4c861c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:08.898 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:08.897+0000 7fe4c861c780 -1 bdev(0x5556efb63c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:52:08.898 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:08.897+0000 7fe4c861c780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:52:11.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:52:11.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:52:11.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:52:11.296 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:52:11.296 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:52:11.551 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:52:11.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:52:11.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:52:11.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:52:11.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:52:11.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:52:11.568 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:11.567+0000 7f2fc921c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:11.570 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:11.568+0000 7f2fc921c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:11.570 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:11.569+0000 7f2fc921c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:11.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:52:11.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:52:11.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:52:11.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:52:11.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:52:11.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:11.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:52:11.741 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:52:11.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:11.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:52:11.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:12.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:12.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:12.932 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:52:12.932 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:52:12.933 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:12.933 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:52:13.119 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:13.164 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:13.162+0000 7f2fc921c780 -1 Falling back to public interface 2026-02-17T12:52:14.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:14.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:14.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:52:14.121 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:52:14.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:14.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:52:14.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:15.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:15.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:15.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:52:15.312 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:52:15.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:15.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:52:15.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:15.857 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:15.856+0000 7f2fc921c780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:52:16.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:16.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:16.505 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:52:16.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:52:16.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:16.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:52:16.699 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3089780975,v1:127.0.0.1:6803/3089780975] [v2:127.0.0.1:6804/3089780975,v1:127.0.0.1:6805/3089780975] exists,up 2279070c-1cc5-4243-98e6-2d07b630a2e7 2026-02-17T12:52:16.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:52:16.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:52:16.701 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:52:16.701 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:754: test_run_osd: get_asok_path osd.0 2026-02-17T12:52:16.701 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T12:52:16.701 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T12:52:16.701 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:16.702 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:16.702 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:16.702 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.0.asok 2026-02-17T12:52:16.702 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:754: test_run_osd: CEPH_ARGS= 2026-02-17T12:52:16.702 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:754: test_run_osd: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-osd.0.asok config get osd_max_backfills 2026-02-17T12:52:16.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:754: test_run_osd: local 'backfills={"osd_max_backfills":"1"}' 2026-02-17T12:52:16.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:755: test_run_osd: echo '{"osd_max_backfills":"1"}' 2026-02-17T12:52:16.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:755: test_run_osd: grep --quiet osd_max_backfills 2026-02-17T12:52:16.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:757: test_run_osd: run_osd td/ceph-helpers 1 --osd-max-backfills 20 2026-02-17T12:52:16.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:52:16.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:52:16.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:52:16.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:52:16.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/1 2026-02-17T12:52:16.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:52:16.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:52:16.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:52:16.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:52:16.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-17T12:52:16.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-17T12:52:16.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:52:16.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:52:16.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:52:16.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:52:16.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:52:16.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:52:16.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:52:16.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:52:16.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:52:16.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+='--osd-max-backfills 20' 2026-02-17T12:52:16.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/1 2026-02-17T12:52:16.755 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:52:16.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=31ce5b95-d145-4caa-bc9f-fc56f0246804 2026-02-17T12:52:16.756 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 31ce5b95-d145-4caa-bc9f-fc56f0246804' 2026-02-17T12:52:16.756 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 31ce5b95-d145-4caa-bc9f-fc56f0246804 2026-02-17T12:52:16.756 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:52:16.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCAZJRpomqWLRAA+ClRlVdALLTGHQXAqeA1Rw== 2026-02-17T12:52:16.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCAZJRpomqWLRAA+ClRlVdALLTGHQXAqeA1Rw=="}' 2026-02-17T12:52:16.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 31ce5b95-d145-4caa-bc9f-fc56f0246804 -i td/ceph-helpers/1/new.json 2026-02-17T12:52:16.962 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:52:16.969 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/1/new.json 2026-02-17T12:52:16.970 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-max-backfills 20 --mkfs --key AQCAZJRpomqWLRAA+ClRlVdALLTGHQXAqeA1Rw== --osd-uuid 31ce5b95-d145-4caa-bc9f-fc56f0246804 2026-02-17T12:52:16.988 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:16.986+0000 7fe534417780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:16.989 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:16.988+0000 7fe534417780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:16.990 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:16.989+0000 7fe534417780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:16.990 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:16.989+0000 7fe534417780 -1 bdev(0x55fad9b7bc00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:52:16.990 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:16.989+0000 7fe534417780 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-17T12:52:19.102 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-17T12:52:19.102 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:52:19.103 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:52:19.103 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:52:19.104 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:52:19.359 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:52:19.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:52:19.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-max-backfills 20 2026-02-17T12:52:19.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:52:19.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:52:19.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:52:19.378 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:19.377+0000 7f8e66c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:19.379 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:19.378+0000 7f8e66c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:19.380 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:19.379+0000 7f8e66c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:19.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:52:19.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:52:19.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:52:19.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:52:19.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:52:19.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:19.549 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:52:19.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:52:19.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:19.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:52:19.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:20.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:20.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:20.738 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:52:20.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:52:20.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:20.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:52:20.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:20.973 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:20.971+0000 7f8e66c13780 -1 Falling back to public interface 2026-02-17T12:52:21.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:21.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:21.929 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:52:21.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:52:21.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:21.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:52:22.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:23.118 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:23.118 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:23.118 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:52:23.119 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:52:23.119 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:23.119 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:52:23.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:23.918 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:23.916+0000 7f8e66c13780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:52:24.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:24.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:24.309 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:52:24.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:52:24.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:24.310 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:52:24.502 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:25.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:25.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:25.504 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:52:25.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:52:25.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:25.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:52:25.691 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1917068778,v1:127.0.0.1:6811/1917068778] [v2:127.0.0.1:6812/1917068778,v1:127.0.0.1:6813/1917068778] exists,up 31ce5b95-d145-4caa-bc9f-fc56f0246804 2026-02-17T12:52:25.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:52:25.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:52:25.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:52:25.693 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:759: test_run_osd: get_asok_path osd.1 2026-02-17T12:52:25.693 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T12:52:25.693 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T12:52:25.693 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:25.693 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:25.693 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:25.693 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.1.asok 2026-02-17T12:52:25.694 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:759: test_run_osd: CEPH_ARGS= 2026-02-17T12:52:25.694 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:759: test_run_osd: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-osd.1.asok config get osd_max_backfills 2026-02-17T12:52:25.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:759: test_run_osd: local 'backfills={"osd_max_backfills":"20"}' 2026-02-17T12:52:25.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:760: test_run_osd: test '{"osd_max_backfills":"20"}' = '{"osd_max_backfills":"20"}' 2026-02-17T12:52:25.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:762: test_run_osd: CEPH_ARGS='--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30' 2026-02-17T12:52:25.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:762: test_run_osd: run_osd td/ceph-helpers 2 2026-02-17T12:52:25.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:52:25.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:52:25.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:52:25.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:52:25.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/2 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30' 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:25.744 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:52:25.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:52:25.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:52:25.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:52:25.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/2 2026-02-17T12:52:25.746 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:52:25.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=76171c8c-9eb8-4ffb-9f1c-1ded77293af0 2026-02-17T12:52:25.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 76171c8c-9eb8-4ffb-9f1c-1ded77293af0' 2026-02-17T12:52:25.747 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 76171c8c-9eb8-4ffb-9f1c-1ded77293af0 2026-02-17T12:52:25.747 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:52:25.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCJZJRpln/0LBAABrSdFwUyVrx+AQ/wkokNAA== 2026-02-17T12:52:25.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCJZJRpln/0LBAABrSdFwUyVrx+AQ/wkokNAA=="}' 2026-02-17T12:52:25.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 76171c8c-9eb8-4ffb-9f1c-1ded77293af0 -i td/ceph-helpers/2/new.json 2026-02-17T12:52:25.956 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:52:25.962 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/2/new.json 2026-02-17T12:52:25.963 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCJZJRpln/0LBAABrSdFwUyVrx+AQ/wkokNAA== --osd-uuid 76171c8c-9eb8-4ffb-9f1c-1ded77293af0 2026-02-17T12:52:25.981 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:25.980+0000 7f9be421a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:25.983 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:25.981+0000 7f9be421a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:25.983 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:25.982+0000 7f9be421a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:25.984 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:25.983+0000 7f9be421a780 -1 bdev(0x564f90675c00 td/ceph-helpers/2/block) open stat got: (1) Operation not permitted 2026-02-17T12:52:25.984 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:25.983+0000 7f9be421a780 -1 bluestore(td/ceph-helpers/2) _read_fsid unparsable uuid 2026-02-17T12:52:28.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/2/keyring 2026-02-17T12:52:28.094 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:52:28.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:52:28.095 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:52:28.095 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:52:28.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:52:28.359 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:52:28.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:52:28.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:52:28.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:52:28.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:52:28.376 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:28.374+0000 7f3a83809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:28.377 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:28.375+0000 7f3a83809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:28.378 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:28.376+0000 7f3a83809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:28.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:52:28.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:52:28.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:52:28.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:52:28.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:52:28.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:28.555 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:52:28.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:52:28.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:28.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:52:28.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:29.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:29.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:29.751 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:52:29.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:52:29.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:29.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:52:29.942 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:29.971 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:29.969+0000 7f3a83809780 -1 Falling back to public interface 2026-02-17T12:52:30.944 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:30.944 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:30.944 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:52:30.945 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:52:30.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:30.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:52:31.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:32.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:32.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:32.140 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:52:32.140 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:52:32.140 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:32.140 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:52:32.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:32.922 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:32.920+0000 7f3a83809780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:52:33.333 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:33.334 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:33.334 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:52:33.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:52:33.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:33.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:52:33.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:34.531 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:34.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:34.532 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:52:34.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:52:34.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:34.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:52:34.728 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/839433342,v1:127.0.0.1:6819/839433342] [v2:127.0.0.1:6820/839433342,v1:127.0.0.1:6821/839433342] exists,up 76171c8c-9eb8-4ffb-9f1c-1ded77293af0 2026-02-17T12:52:34.729 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:52:34.730 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:52:34.730 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:52:34.730 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:764: test_run_osd: get_asok_path osd.2 2026-02-17T12:52:34.730 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2026-02-17T12:52:34.730 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2026-02-17T12:52:34.730 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:34.730 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:34.730 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:34.731 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-osd.2.asok 2026-02-17T12:52:34.731 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:764: test_run_osd: CEPH_ARGS= 2026-02-17T12:52:34.731 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:764: test_run_osd: ceph --format=json daemon /tmp/ceph-asok.83920/ceph-osd.2.asok config get osd_max_backfills 2026-02-17T12:52:34.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:764: test_run_osd: local 'backfills={"osd_max_backfills":"30"}' 2026-02-17T12:52:34.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:765: test_run_osd: test '{"osd_max_backfills":"30"}' = '{"osd_max_backfills":"30"}' 2026-02-17T12:52:34.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:767: test_run_osd: teardown td/ceph-helpers 2026-02-17T12:52:34.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:52:34.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:52:34.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:52:34.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:34.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:34.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:34.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:34.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:34.885 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:34.886 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:52:34.886 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:52:34.887 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:52:34.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:52:34.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:52:34.889 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:52:34.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:34.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:52:34.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:52:34.891 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:34.891 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:52:34.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:52:34.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:52:34.898 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:52:34.898 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:34.898 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:34.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:52:34.900 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:52:34.900 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:52:34.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:52:34.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_set_config td/ceph-helpers 2026-02-17T12:52:34.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: test_set_config: local dir=td/ceph-helpers 2026-02-17T12:52:34.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1174: test_set_config: setup td/ceph-helpers 2026-02-17T12:52:34.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:52:34.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:52:34.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:52:34.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:52:34.901 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:52:34.901 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:34.901 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:34.902 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:34.902 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:34.902 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:34.902 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:34.903 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:52:34.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:52:34.903 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:52:34.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:52:34.903 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:52:34.904 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:52:34.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:34.904 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:52:34.905 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:52:34.905 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:34.905 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:52:34.906 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:52:34.906 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:52:34.908 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:52:34.908 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:34.908 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:34.908 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:52:34.909 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:52:34.909 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:52:34.909 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:52:34.910 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:52:34.910 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:34.910 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:34.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:52:34.911 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:52:34.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:52:34.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:52:34.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:52:34.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1175: test_set_config: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:52:34.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:52:34.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:52:34.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:52:34.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:52:34.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:52:34.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:52:34.932 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:52:34.933 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:34.933 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:34.933 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:34.933 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:34.933 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:34.933 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:34.934 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:52:34.959 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:52:34.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:52:34.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:34.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:34.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:52:34.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:52:34.961 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:34.961 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:34.961 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:34.961 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:34.961 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:34.961 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:34.962 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:34.962 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:34.962 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:52:35.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:52:35.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:35.009 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:35.009 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:52:35.009 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:52:35.009 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:35.009 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:35.009 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:35.010 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:35.010 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.010 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.010 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:35.010 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:35.010 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:52:35.054 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1176: test_set_config: get_config mon a ms_crc_header 2026-02-17T12:52:35.054 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:35.054 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:35.054 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=ms_crc_header 2026-02-17T12:52:35.054 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .ms_crc_header 2026-02-17T12:52:35.054 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:35.055 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:35.055 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:35.056 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:35.056 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.056 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.056 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:35.056 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:35.056 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get ms_crc_header 2026-02-17T12:52:35.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1176: test_set_config: test true = true 2026-02-17T12:52:35.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1177: test_set_config: set_config mon a ms_crc_header false 2026-02-17T12:52:35.098 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=mon 2026-02-17T12:52:35.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=a 2026-02-17T12:52:35.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=ms_crc_header 2026-02-17T12:52:35.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=false 2026-02-17T12:52:35.099 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T12:52:35.100 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path mon.a 2026-02-17T12:52:35.100 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:35.100 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:35.100 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:35.100 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.100 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.101 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:35.101 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config set ms_crc_header false 2026-02-17T12:52:35.143 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T12:52:35.145 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1178: test_set_config: get_config mon a ms_crc_header 2026-02-17T12:52:35.145 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:35.145 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:35.146 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=ms_crc_header 2026-02-17T12:52:35.146 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .ms_crc_header 2026-02-17T12:52:35.146 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:35.146 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:35.146 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:35.146 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:35.146 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.146 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.146 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:35.146 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:35.146 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get ms_crc_header 2026-02-17T12:52:35.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1178: test_set_config: test false = false 2026-02-17T12:52:35.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1179: test_set_config: set_config mon a ms_crc_header true 2026-02-17T12:52:35.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=mon 2026-02-17T12:52:35.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=a 2026-02-17T12:52:35.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=ms_crc_header 2026-02-17T12:52:35.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T12:52:35.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T12:52:35.190 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path mon.a 2026-02-17T12:52:35.190 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:35.190 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:35.190 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:35.190 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.190 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.190 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:35.190 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config set ms_crc_header true 2026-02-17T12:52:35.233 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T12:52:35.234 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1180: test_set_config: get_config mon a ms_crc_header 2026-02-17T12:52:35.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:35.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:35.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=ms_crc_header 2026-02-17T12:52:35.235 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .ms_crc_header 2026-02-17T12:52:35.235 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:35.235 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:35.235 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:35.235 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:35.235 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.235 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.236 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:35.236 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:35.236 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get ms_crc_header 2026-02-17T12:52:35.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1180: test_set_config: test true = true 2026-02-17T12:52:35.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1181: test_set_config: teardown td/ceph-helpers 2026-02-17T12:52:35.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:52:35.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:52:35.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:52:35.278 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:35.279 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:35.279 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:35.279 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:35.279 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:35.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:35.384 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:52:35.385 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:52:35.385 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:52:35.386 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:52:35.386 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:52:35.387 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:52:35.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:52:35.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:52:35.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:52:35.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:52:35.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:52:35.392 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:52:35.392 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.392 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:52:35.394 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:52:35.394 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:52:35.394 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:52:35.394 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_setup td/ceph-helpers 2026-02-17T12:52:35.394 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:144: test_setup: local dir=td/ceph-helpers 2026-02-17T12:52:35.394 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:145: test_setup: setup td/ceph-helpers 2026-02-17T12:52:35.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:52:35.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:52:35.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:52:35.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:52:35.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:52:35.395 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:35.395 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:35.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:35.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:35.396 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:35.396 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:35.397 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:52:35.397 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:52:35.397 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:52:35.397 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:52:35.397 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:52:35.398 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:52:35.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.398 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:52:35.399 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:52:35.399 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.399 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:52:35.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:52:35.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:52:35.402 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:52:35.402 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.402 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:52:35.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:52:35.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:52:35.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:52:35.404 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:52:35.404 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.404 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.404 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:52:35.405 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:52:35.406 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:146: test_setup: test -d td/ceph-helpers 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:147: test_setup: setup td/ceph-helpers 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:35.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:35.408 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:35.408 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:35.408 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:35.408 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:52:35.409 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:52:35.409 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:52:35.410 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:52:35.410 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:52:35.410 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:52:35.411 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.411 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:52:35.411 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:52:35.411 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.412 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:52:35.413 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:52:35.413 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:52:35.414 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:52:35.414 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.414 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.414 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:52:35.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:52:35.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:52:35.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:52:35.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:52:35.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.416 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:52:35.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:52:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:52:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:52:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:52:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:148: test_setup: test -d td/ceph-helpers 2026-02-17T12:52:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:149: test_setup: teardown td/ceph-helpers 2026-02-17T12:52:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:52:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:52:35.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:52:35.419 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:35.419 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:35.420 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:35.420 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:35.420 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:35.420 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:35.420 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:52:35.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:52:35.421 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:52:35.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:52:35.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:52:35.422 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:52:35.423 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.423 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:52:35.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:52:35.424 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:52:35.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:52:35.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:52:35.427 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:52:35.427 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.427 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_teardown td/ceph-helpers 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:220: test_teardown: local dir=td/ceph-helpers 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:221: test_teardown: setup td/ceph-helpers 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:52:35.429 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:35.430 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:35.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:35.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:35.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:35.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:35.430 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:52:35.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:52:35.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:52:35.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:52:35.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:52:35.432 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:52:35.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:52:35.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:52:35.434 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:52:35.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:52:35.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:52:35.436 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:52:35.436 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.437 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:52:35.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:52:35.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:52:35.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:52:35.439 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:52:35.439 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.439 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:52:35.440 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:52:35.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:52:35.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:52:35.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:52:35.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:222: test_teardown: teardown td/ceph-helpers 2026-02-17T12:52:35.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:52:35.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:52:35.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:52:35.442 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:35.442 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:35.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:35.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:35.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:35.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:35.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:52:35.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:52:35.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:52:35.444 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:52:35.444 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:52:35.445 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:52:35.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:52:35.446 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:52:35.446 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:35.446 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:52:35.447 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:52:35.447 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:52:35.449 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:52:35.449 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:35.449 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:35.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:52:35.451 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:223: test_teardown: test -d td/ceph-helpers 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_wait_background td/ceph-helpers 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2244: test_wait_background: local pids= 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2245: test_wait_background: run_in_background pids bash -c 'sleep 1; exit 1' 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2190: run_in_background: local pid_variable=pids 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2191: run_in_background: shift 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: eval 'pids+=" 152102"' 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: pids+=' 152102' 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2246: test_wait_background: run_in_background pids bash -c 'sleep 2; exit 0' 2026-02-17T12:52:35.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2190: run_in_background: local pid_variable=pids 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2191: run_in_background: shift 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: eval 'pids+=" 152103"' 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: pids+=' 152103' 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2247: test_wait_background: wait_background pids 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2226: wait_background: pids=' 152102 152103' 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2228: wait_background: return_code=0 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2229: wait_background: for pid in $pids 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: wait 152102 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: bash -c 'sleep 1; exit 1' 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: sed 's/^/152105: /' 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: bash -c 'sleep 2; exit 0' 2026-02-17T12:52:35.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: sed 's/^/152107: /' 2026-02-17T12:52:36.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: return 1 2026-02-17T12:52:36.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return_code=1 2026-02-17T12:52:36.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2229: wait_background: for pid in $pids 2026-02-17T12:52:36.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: wait 152103 2026-02-17T12:52:37.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: return 0 2026-02-17T12:52:37.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2237: wait_background: eval 'pids='\'''\''' 2026-02-17T12:52:37.454 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2237: wait_background: pids= 2026-02-17T12:52:37.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2239: wait_background: return 1 2026-02-17T12:52:37.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2248: test_wait_background: '[' 1 -ne 1 ']' 2026-02-17T12:52:37.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2250: test_wait_background: run_in_background pids bash -c 'sleep 1; exit 0' 2026-02-17T12:52:37.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2190: run_in_background: local pid_variable=pids 2026-02-17T12:52:37.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2191: run_in_background: shift 2026-02-17T12:52:37.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: eval 'pids+=" 152110"' 2026-02-17T12:52:37.455 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: pids+=' 152110' 2026-02-17T12:52:37.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2251: test_wait_background: run_in_background pids bash -c 'sleep 2; exit 0' 2026-02-17T12:52:37.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2190: run_in_background: local pid_variable=pids 2026-02-17T12:52:37.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2191: run_in_background: shift 2026-02-17T12:52:37.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: eval 'pids+=" 152111"' 2026-02-17T12:52:37.455 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2195: run_in_background: pids+=' 152111' 2026-02-17T12:52:37.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2252: test_wait_background: wait_background pids 2026-02-17T12:52:37.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2226: wait_background: pids=' 152110 152111' 2026-02-17T12:52:37.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2228: wait_background: return_code=0 2026-02-17T12:52:37.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2229: wait_background: for pid in $pids 2026-02-17T12:52:37.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: wait 152110 2026-02-17T12:52:37.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: bash -c 'sleep 1; exit 0' 2026-02-17T12:52:37.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: sed 's/^/152113: /' 2026-02-17T12:52:37.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: bash -c 'sleep 2; exit 0' 2026-02-17T12:52:37.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: sed 's/^/152115: /' 2026-02-17T12:52:38.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: return 0 2026-02-17T12:52:38.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2229: wait_background: for pid in $pids 2026-02-17T12:52:38.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: wait 152111 2026-02-17T12:52:39.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2194: run_in_background: return 0 2026-02-17T12:52:39.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2237: wait_background: eval 'pids='\'''\''' 2026-02-17T12:52:39.458 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2237: wait_background: pids= 2026-02-17T12:52:39.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2239: wait_background: return 0 2026-02-17T12:52:39.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: test_wait_background: '[' 0 -ne 0 ']' 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: test_wait_background: '[' '!' -z '' ']' 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_wait_for_clean td/ceph-helpers 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1691: test_wait_for_clean: local dir=td/ceph-helpers 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1693: test_wait_for_clean: setup td/ceph-helpers 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:52:39.459 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:52:39.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:52:39.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:52:39.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:52:39.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:52:39.461 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:52:39.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:52:39.462 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:52:39.463 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:52:39.463 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:52:39.463 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:52:39.464 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:39.464 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:52:39.464 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:52:39.465 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:52:39.465 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:52:39.466 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:52:39.466 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:52:39.467 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:52:39.467 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:39.468 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:39.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:52:39.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:52:39.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:52:39.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:52:39.469 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:52:39.470 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:39.470 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:39.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:52:39.470 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:52:39.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:52:39.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:52:39.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:52:39.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1694: test_wait_for_clean: run_mon td/ceph-helpers a --osd_pool_default_size=2 2026-02-17T12:52:39.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:52:39.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:52:39.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:52:39.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:52:39.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:52:39.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2026-02-17T12:52:39.492 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:52:39.492 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:39.492 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:39.492 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:39.492 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:39.492 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:39.492 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:39.492 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T12:52:39.519 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:52:39.520 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:52:39.520 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:39.520 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:39.520 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:52:39.520 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:52:39.521 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:39.521 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:39.521 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:39.522 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:39.522 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:39.522 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:39.522 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:39.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:39.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:52:39.565 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:52:39.565 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:52:39.565 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:52:39.565 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:52:39.565 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:52:39.565 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:52:39.565 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:52:39.566 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:52:39.566 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:52:39.566 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:39.566 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:39.566 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:52:39.566 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:52:39.567 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:52:39.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1695: test_wait_for_clean: run_osd td/ceph-helpers 0 2026-02-17T12:52:39.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:52:39.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:52:39.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:52:39.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:52:39.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:52:39.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:52:39.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:52:39.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:52:39.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:52:39.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:39.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:52:39.614 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:52:39.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=5d7c44be-d4e2-40ec-a263-9d6d3add6107 2026-02-17T12:52:39.615 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 5d7c44be-d4e2-40ec-a263-9d6d3add6107 2026-02-17T12:52:39.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 5d7c44be-d4e2-40ec-a263-9d6d3add6107' 2026-02-17T12:52:39.616 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:52:39.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCXZJRpCWUbJRAAkbl5jEsdWFon6BlWSQ/gQg== 2026-02-17T12:52:39.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCXZJRpCWUbJRAAkbl5jEsdWFon6BlWSQ/gQg=="}' 2026-02-17T12:52:39.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 5d7c44be-d4e2-40ec-a263-9d6d3add6107 -i td/ceph-helpers/0/new.json 2026-02-17T12:52:39.725 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:52:39.730 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:52:39.731 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCXZJRpCWUbJRAAkbl5jEsdWFon6BlWSQ/gQg== --osd-uuid 5d7c44be-d4e2-40ec-a263-9d6d3add6107 2026-02-17T12:52:39.748 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:39.746+0000 7f5116b4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:39.750 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:39.747+0000 7f5116b4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:39.750 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:39.748+0000 7f5116b4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:39.751 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:39.749+0000 7f5116b4f780 -1 bdev(0x563798345c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:52:39.751 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:39.749+0000 7f5116b4f780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:52:41.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:52:41.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:52:41.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:52:41.867 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:52:41.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:52:41.967 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:52:41.968 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:52:41.968 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:52:41.968 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:52:41.968 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:52:41.968 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:52:41.984 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:41.982+0000 7fc13e80d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:41.985 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:41.983+0000 7fc13e80d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:41.986 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:41.984+0000 7fc13e80d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:42.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:52:42.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:52:42.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:52:42.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:52:42.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:52:42.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:42.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:52:42.067 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:52:42.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:42.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:52:42.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:43.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:43.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:43.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:52:43.166 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:52:43.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:43.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:52:43.264 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:43.560 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:43.558+0000 7fc13e80d780 -1 Falling back to public interface 2026-02-17T12:52:44.266 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:44.266 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:44.266 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:52:44.266 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:52:44.267 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:44.267 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:52:44.363 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:45.364 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:45.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:45.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:52:45.365 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:52:45.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:45.366 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:52:45.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:46.265 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:46.263+0000 7fc13e80d780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:52:46.464 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:46.464 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:46.464 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:52:46.465 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:52:46.465 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:46.465 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:52:46.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:47.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:47.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:47.563 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:52:47.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:52:47.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:47.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:52:47.661 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4188795328,v1:127.0.0.1:6801/4188795328] [v2:127.0.0.1:6802/4188795328,v1:127.0.0.1:6803/4188795328] exists,up 5d7c44be-d4e2-40ec-a263-9d6d3add6107 2026-02-17T12:52:47.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:52:47.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:52:47.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:52:47.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1696: test_wait_for_clean: run_mgr td/ceph-helpers x 2026-02-17T12:52:47.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:52:47.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:52:47.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:52:47.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:52:47.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:52:47.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:52:47.765 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:52:47.766 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:47.766 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:47.766 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:47.766 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:47.766 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:47.766 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:47.767 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:52:47.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:52:47.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1697: test_wait_for_clean: create_rbd_pool 2026-02-17T12:52:47.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:52:47.878 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:52:47.884 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:52:47.885 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:52:48.058 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:52:48.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:52:49.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:52:49.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1698: test_wait_for_clean: WAIT_FOR_CLEAN_TIMEOUT=1 2026-02-17T12:52:49.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1698: test_wait_for_clean: wait_for_clean 2026-02-17T12:52:49.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:52:49.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:52:49.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:52:49.345 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 1 .1 2026-02-17T12:52:49.346 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:52:49.346 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:52:49.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:52:49.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:52:49.347 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:52:49.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.3') 2026-02-17T12:52:49.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:52:49.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:52:49.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:52:49.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:52:49.370 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:52:49.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:52:49.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:52:49.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:52:49.471 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:52:49.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=0 2026-02-17T12:52:49.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 0 2026-02-17T12:52:49.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-0' 2026-02-17T12:52:49.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:52:49.533 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-0 2026-02-17T12:52:49.533 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:52:49.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:52:49.534 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-0 2026-02-17T12:52:49.534 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:52:49.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=0 2026-02-17T12:52:49.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 0' 2026-02-17T12:52:49.536 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 0 2026-02-17T12:52:49.536 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:52:49.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 0 -lt 0 2026-02-17T12:52:49.636 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:52:49.637 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:52:49.637 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:52:49.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 == 0 2026-02-17T12:52:49.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: sleep 1 2026-02-17T12:52:50.737 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:52:50.738 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:52:50.738 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:52:50.993 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:52:50.993 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:52:50.993 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:52:50.993 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:52:50.993 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:52:50.993 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:52:50.994 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:52:50.994 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:52:51.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:52:51.180 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:52:51.181 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:52:51.181 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:52:51.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:52:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' -1 2026-02-17T12:52:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T12:52:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=0 2026-02-17T12:52:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:52:51.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T12:52:51.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:52:51.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:52:51.533 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:52:51.533 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:52:51.533 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:52:51.534 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:52:51.534 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:52:51.534 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:52:51.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:52:51.725 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:52:51.726 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:52:51.726 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:52:51.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:52:51.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:52:51.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:52:51.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:52:51.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:52:51.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:52:51.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:52:51.975 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:52:51.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:52:52.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:52:52.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:52:52.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 1 >= 4 )) 2026-02-17T12:52:52.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:52:52.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.2 2026-02-17T12:52:52.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:52:52.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:52:52.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:52:52.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:52:52.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:52:52.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:52:52.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:52:52.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:52:52.618 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:52:52.618 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:52:52.619 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:52:52.619 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:52:52.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:52:52.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:52:52.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:52:52.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:52:52.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:52:52.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:52:52.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:52:52.868 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:52:52.868 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:52:53.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:52:53.120 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:52:53.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 2 >= 4 )) 2026-02-17T12:52:53.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:52:53.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.4 2026-02-17T12:52:53.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:52:53.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:52:53.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:52:53.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:52:53.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:52:53.523 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:52:53.523 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:52:53.523 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:52:53.711 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:52:53.712 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:52:53.712 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:52:53.712 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:52:53.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:52:53.960 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:52:53.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:52:53.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:52:53.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:52:53.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:52:53.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:52:53.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:52:53.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:52:54.213 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:52:54.213 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:52:54.213 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 3 >= 4 )) 2026-02-17T12:52:54.213 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:52:54.213 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.3 2026-02-17T12:52:54.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:52:54.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:52:54.515 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:52:54.515 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:52:54.515 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:52:54.515 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:52:54.515 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:52:54.515 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:52:54.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:52:54.708 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:52:54.708 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:52:54.709 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:52:54.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:52:54.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:52:54.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:52:54.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:52:54.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:52:54.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:52:54.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:52:54.959 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:52:54.959 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:52:55.212 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:52:55.212 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:52:55.212 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 4 >= 4 )) 2026-02-17T12:52:55.213 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1679: wait_for_clean: ceph report 2026-02-17T12:52:55.460 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:52:55.460 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_fingerprint": "c27005b5-78d7-4199-8cbd-48a19cca30c8", 2026-02-17T12:52:55.460 INFO:tasks.workunit.client.0.trial155.stdout: "version": "19.2.3-675-g3c96dfb3", 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: "commit": "3c96dfb3f50b3d02598a82af7104764bfdcd3919", 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: "timestamp": "2026-02-17T12:52:55.459151+0000", 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: "tag": "", 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: "health": { 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: "status": "HEALTH_WARN", 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: "checks": { 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: "PG_DEGRADED": { 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: "severity": "HEALTH_WARN", 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: "summary": { 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: "message": "Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded", 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: "count": 2 2026-02-17T12:52:55.461 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.462 INFO:tasks.workunit.client.0.trial155.stdout: "detail": [ 2026-02-17T12:52:55.462 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.462 INFO:tasks.workunit.client.0.trial155.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0]" 2026-02-17T12:52:55.462 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.462 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.462 INFO:tasks.workunit.client.0.trial155.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0]" 2026-02-17T12:52:55.462 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.462 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.462 INFO:tasks.workunit.client.0.trial155.stdout: "muted": false 2026-02-17T12:52:55.462 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.462 INFO:tasks.workunit.client.0.trial155.stdout: "TOO_FEW_OSDS": { 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: "severity": "HEALTH_WARN", 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: "summary": { 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: "message": "OSD count 1 < osd_pool_default_size 3", 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: "count": 2 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: "detail": [], 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: "muted": false 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: "mutes": [] 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: "monmap_first_committed": 1, 2026-02-17T12:52:55.463 INFO:tasks.workunit.client.0.trial155.stdout: "monmap_last_committed": 1, 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "monmap": { 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 1, 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "fsid": "af5bea88-7d02-4f39-9b2e-26dff0e1f9f6", 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "modified": "2026-02-17T12:52:39.485371Z", 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "created": "2026-02-17T12:52:39.485371Z", 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "min_mon_release": 19, 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "min_mon_release_name": "squid", 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "election_strategy": 1, 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "disallowed_leaders": "", 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode": false, 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "tiebreaker_mon": "", 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "removed_ranks": "", 2026-02-17T12:52:55.464 INFO:tasks.workunit.client.0.trial155.stdout: "features": { 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "persistent": [ 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "kraken", 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "luminous", 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "mimic", 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap-prune", 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "nautilus", 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "octopus", 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "pacific", 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "elector-pinging", 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "quincy", 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "reef", 2026-02-17T12:52:55.465 INFO:tasks.workunit.client.0.trial155.stdout: "squid" 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: "optional": [] 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: "mons": [ 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: "rank": 0, 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: "name": "a", 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: "public_addrs": { 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:52:55.466 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:7109", 2026-02-17T12:52:55.467 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 0 2026-02-17T12:52:55.467 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.467 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.467 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.467 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:7109/0", 2026-02-17T12:52:55.467 INFO:tasks.workunit.client.0.trial155.stdout: "public_addr": "127.0.0.1:7109/0", 2026-02-17T12:52:55.467 INFO:tasks.workunit.client.0.trial155.stdout: "priority": 0, 2026-02-17T12:52:55.467 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 0, 2026-02-17T12:52:55.467 INFO:tasks.workunit.client.0.trial155.stdout: "crush_location": "{}" 2026-02-17T12:52:55.467 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.467 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.468 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.468 INFO:tasks.workunit.client.0.trial155.stdout: "quorum": [ 2026-02-17T12:52:55.468 INFO:tasks.workunit.client.0.trial155.stdout: 0 2026-02-17T12:52:55.468 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.468 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap": { 2026-02-17T12:52:55.468 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 12, 2026-02-17T12:52:55.468 INFO:tasks.workunit.client.0.trial155.stdout: "fsid": "af5bea88-7d02-4f39-9b2e-26dff0e1f9f6", 2026-02-17T12:52:55.468 INFO:tasks.workunit.client.0.trial155.stdout: "created": "2026-02-17T12:52:39.520535+0000", 2026-02-17T12:52:55.468 INFO:tasks.workunit.client.0.trial155.stdout: "modified": "2026-02-17T12:52:49.338708+0000", 2026-02-17T12:52:55.468 INFO:tasks.workunit.client.0.trial155.stdout: "last_up_change": "2026-02-17T12:52:46.864059+0000", 2026-02-17T12:52:55.468 INFO:tasks.workunit.client.0.trial155.stdout: "last_in_change": "2026-02-17T12:52:39.702328+0000", 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "flags_num": 5799936, 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "flags_set": [ 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "pglog_hardlimit", 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "purged_snapdirs", 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "recovery_deletes", 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "sortbitwise" 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "crush_version": 3, 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T12:52:55.469 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_snapshot": "", 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: "pool_max": 1, 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: "max_osd": 1, 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: "require_min_compat_client": "luminous", 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: "min_compat_client": "jewel", 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: "require_osd_release": "squid", 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: "allow_crimson": false, 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: "pools": [ 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: "pool": 1, 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: "pool_name": "rbd", 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: "create_time": "2026-02-17T12:52:47.966837+0000", 2026-02-17T12:52:55.470 INFO:tasks.workunit.client.0.trial155.stdout: "flags": 8193, 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "type": 1, 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "size": 2, 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "min_size": 1, 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "crush_rule": 0, 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_count": 0, 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_target": 0, 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "is_stretch_pool": false, 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "object_hash": 2, 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "pg_autoscale_mode": "off", 2026-02-17T12:52:55.471 INFO:tasks.workunit.client.0.trial155.stdout: "pg_num": 4, 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "pg_placement_num": 4, 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "pg_placement_num_target": 4, 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "pg_num_target": 4, 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "pg_num_pending": 4, 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "last_pg_merge_meta": { 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "source_pgid": "0.0", 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "ready_epoch": 0, 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "last_epoch_started": 0, 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "last_epoch_clean": 0, 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "source_version": "0'0", 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "target_version": "0'0" 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.472 INFO:tasks.workunit.client.0.trial155.stdout: "last_change": "12", 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "last_force_op_resend": "0", 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "auid": 0, 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "snap_mode": "selfmanaged", 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "snap_seq": 2, 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "snap_epoch": 12, 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "pool_snaps": [], 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "removed_snaps": "[]", 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "quota_max_bytes": 0, 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "quota_max_objects": 0, 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "tiers": [], 2026-02-17T12:52:55.473 INFO:tasks.workunit.client.0.trial155.stdout: "tier_of": -1, 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "read_tier": -1, 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "write_tier": -1, 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "cache_mode": "none", 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "target_max_bytes": 0, 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "target_max_objects": 0, 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "cache_min_flush_age": 0, 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "cache_min_evict_age": 0, 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "erasure_code_profile": "", 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_params": { 2026-02-17T12:52:55.474 INFO:tasks.workunit.client.0.trial155.stdout: "type": "none" 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_period": 0, 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_count": 0, 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "use_gmt_hitset": true, 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "min_read_recency_for_promote": 0, 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "min_write_recency_for_promote": 0, 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_search_last_n": 0, 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "grade_table": [], 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "stripe_width": 0, 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "expected_num_objects": 0, 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "fast_read": false, 2026-02-17T12:52:55.475 INFO:tasks.workunit.client.0.trial155.stdout: "options": {}, 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "application_metadata": { 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "rbd": {} 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "read_balance": { 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "score_type": "Fair distribution", 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "score_acting": 1, 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "score_stable": 1, 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "optimal_score": 1, 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "raw_score_acting": 1, 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "raw_score_stable": 1, 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "primary_affinity_weighted": 1, 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "average_primary_affinity": 1, 2026-02-17T12:52:55.476 INFO:tasks.workunit.client.0.trial155.stdout: "average_primary_affinity_weighted": 1 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: "osds": [ 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: "uuid": "5d7c44be-d4e2-40ec-a263-9d6d3add6107", 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: "up": 1, 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: "in": 1, 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 1, 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: "primary_affinity": 1, 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: "last_clean_begin": 0, 2026-02-17T12:52:55.477 INFO:tasks.workunit.client.0.trial155.stdout: "last_clean_end": 0, 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: "up_from": 5, 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: "up_thru": 7, 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: "down_at": 0, 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: "lost_at": 0, 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: "public_addrs": { 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6800", 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 4188795328 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.478 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6801", 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 4188795328 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_addrs": { 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6802", 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 4188795328 2026-02-17T12:52:55.479 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6803", 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 4188795328 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_back_addrs": { 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6806", 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 4188795328 2026-02-17T12:52:55.480 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6807", 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 4188795328 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_front_addrs": { 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:52:55.481 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6804", 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 4188795328 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6805", 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 4188795328 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: "public_addr": "127.0.0.1:6801/4188795328", 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_addr": "127.0.0.1:6803/4188795328", 2026-02-17T12:52:55.482 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_back_addr": "127.0.0.1:6807/4188795328", 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_front_addr": "127.0.0.1:6805/4188795328", 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: "state": [ 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: "exists", 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: "up" 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: "osd_xinfo": [ 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: "down_stamp": "0.000000", 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: "laggy_probability": 0, 2026-02-17T12:52:55.483 INFO:tasks.workunit.client.0.trial155.stdout: "laggy_interval": 0, 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: "features": 4540701547738038271, 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: "old_weight": 0, 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: "last_purged_snaps_scrub": "2026-02-17T12:52:47.220871+0000", 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: "dead_epoch": 0 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: "pg_upmap": [], 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: "pg_upmap_items": [], 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: "pg_upmap_primaries": [], 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: "pg_temp": [], 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: "primary_temp": [], 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: "blocklist": {}, 2026-02-17T12:52:55.484 INFO:tasks.workunit.client.0.trial155.stdout: "range_blocklist": {}, 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: "erasure_code_profiles": { 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: "default": { 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: "k": "2", 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: "m": "2", 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: "plugin": "jerasure", 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: "technique": "reed_sol_van" 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: "removed_snaps_queue": [ 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: "pool": 1, 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: "snaps": [ 2026-02-17T12:52:55.485 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: "begin": 2, 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: "length": 1 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: "new_removed_snaps": [ 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: "pool": 1, 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: "snaps": [ 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: "begin": 2, 2026-02-17T12:52:55.486 INFO:tasks.workunit.client.0.trial155.stdout: "length": 1 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: "new_purged_snaps": [], 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: "crush_node_flags": {}, 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: "device_class_flags": {}, 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode": { 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode_enabled": false, 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_bucket_count": 0, 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: "degraded_stretch_mode": 0, 2026-02-17T12:52:55.487 INFO:tasks.workunit.client.0.trial155.stdout: "recovering_stretch_mode": 0, 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode_bucket": 0 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: "osd_metadata": [ 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: "arch": "x86_64", 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: "back_addr": "[v2:127.0.0.1:6802/4188795328,v1:127.0.0.1:6803/4188795328]", 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: "back_iface": "", 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs": "1", 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs_dedicated_db": "0", 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T12:52:55.488 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs_single_shared_device": "1", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_allocator": "hybrid", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_path": "td/ceph-helpers/0/block", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T12:52:55.489 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_release": "squid", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_version": "ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable)", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_version_short": "19.2.3-675-g3c96dfb3", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_version_when_created": "ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable)", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "created_at": "2026-02-17T12:52:41.347481Z", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "default_device_class": "ssd", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD5F82", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "devices": "nvme0n1", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "distro": "centos", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T12:52:55.490 INFO:tasks.workunit.client.0.trial155.stdout: "distro_version": "9", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "front_addr": "[v2:127.0.0.1:6800/4188795328,v1:127.0.0.1:6801/4188795328]", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "front_iface": "", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/4188795328,v1:127.0.0.1:6807/4188795328]", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/4188795328,v1:127.0.0.1:6805/4188795328]", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "hostname": "trial155", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "journal_rotational": "0", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "mem_swap_kb": "8388604", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "mem_total_kb": "130438932", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "objectstore_numa_node": "0", 2026-02-17T12:52:55.491 INFO:tasks.workunit.client.0.trial155.stdout: "objectstore_numa_nodes": "0", 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: "os": "Linux", 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: "osd_data": "td/ceph-helpers/0", 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: "osd_objectstore": "bluestore", 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: "osdspec_affinity": "", 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: "rotational": "0" 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap_clean_epochs": { 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: "min_last_epoch_clean": 0, 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: "last_epoch_clean": { 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: "per_pool": [] 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.492 INFO:tasks.workunit.client.0.trial155.stdout: "osd_epochs": [ 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 5 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap_first_committed": 1, 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap_last_committed": 12, 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: "crushmap": { 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: "devices": [ 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:52:55.493 INFO:tasks.workunit.client.0.trial155.stdout: "name": "osd.0", 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: "class": "ssd" 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: "types": [ 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 0, 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: "name": "osd" 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 1, 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: "name": "host" 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.494 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 2, 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: "name": "chassis" 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 3, 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: "name": "rack" 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 4, 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: "name": "row" 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 5, 2026-02-17T12:52:55.495 INFO:tasks.workunit.client.0.trial155.stdout: "name": "pdu" 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 6, 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: "name": "pod" 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 7, 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: "name": "room" 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 8, 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: "name": "datacenter" 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 9, 2026-02-17T12:52:55.496 INFO:tasks.workunit.client.0.trial155.stdout: "name": "zone" 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 10, 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: "name": "region" 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 11, 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: "name": "root" 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: "buckets": [ 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: "id": -1, 2026-02-17T12:52:55.497 INFO:tasks.workunit.client.0.trial155.stdout: "name": "default", 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 11, 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "root", 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: "id": -3, 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.498 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: "id": -2, 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: "name": "default~ssd", 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 11, 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "root", 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: "id": -4, 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.499 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "id": -3, 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "name": "trial155", 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 1, 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "host", 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.500 INFO:tasks.workunit.client.0.trial155.stdout: "id": -4, 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: "name": "trial155~ssd", 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 1, 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "host", 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.501 INFO:tasks.workunit.client.0.trial155.stdout: "rules": [ 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: "rule_id": 0, 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: "rule_name": "replicated_rule", 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: "type": 1, 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: "steps": [ 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: "op": "take", 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: "item": -1, 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: "item_name": "default" 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: "op": "choose_firstn", 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: "num": 0, 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: "type": "osd" 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: "op": "emit" 2026-02-17T12:52:55.502 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "tunables": { 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "choose_local_tries": 0, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "choose_local_fallback_tries": 0, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "choose_total_tries": 50, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "chooseleaf_descend_once": 1, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "chooseleaf_vary_r": 1, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "chooseleaf_stable": 1, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "msr_descents": 100, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "msr_collision_tries": 100, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "straw_calc_version": 1, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "allowed_bucket_algs": 54, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "profile": "jewel", 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "optimal_tunables": 1, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "legacy_tunables": 0, 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "minimum_required_version": "jewel", 2026-02-17T12:52:55.503 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables": 1, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables2": 1, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "has_v2_rules": 0, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables3": 1, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "has_v3_rules": 0, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "has_v4_buckets": 1, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables5": 1, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "has_v5_rules": 0, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "has_msr_rules": 0 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "choose_args": {} 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "fsmap": { 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 1, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "btime": "2026-02-17T12:52:39:520384+0000", 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "default_fscid": -1, 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "compat": { 2026-02-17T12:52:55.504 INFO:tasks.workunit.client.0.trial155.stdout: "compat": {}, 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "ro_compat": {}, 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "incompat": { 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_1": "base v0.20", 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_2": "client writeable ranges", 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_4": "dir inode in separate object", 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_8": "no anchor table", 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_9": "file layout v2", 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_10": "snaprealm v2", 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_11": "minor log segments", 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "feature_flags": { 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "enable_multiple": true, 2026-02-17T12:52:55.505 INFO:tasks.workunit.client.0.trial155.stdout: "ever_enabled_multiple": true 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "standbys": [], 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "filesystems": [] 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "mdsmap_first_committed": 1, 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "mdsmap_last_committed": 1, 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "auth": { 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "first_committed": 1, 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "last_committed": 3, 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "num_secrets": 1 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg": 4, 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_active": 4, 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_unknown": 0, 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "num_osd": 1, 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "pool_sum": { 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "stat_sum": { 2026-02-17T12:52:55.506 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes": 19, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects": 2, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_clones": 0, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_copies": 4, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing": 0, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_degraded": 2, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_misplaced": 0, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_unfound": 0, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_dirty": 2, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_whiteouts": 0, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_read": 0, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_read_kb": 0, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_write": 2, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_write_kb": 2, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_scrub_errors": 0, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_deep_scrub_errors": 0, 2026-02-17T12:52:55.507 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_recovered": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_recovered": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_keys_recovered": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_omap": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_kb": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_kb": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_promote": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_high": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_low": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_some": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_full": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_pinned": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_legacy_snapsets": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_large_omap_objects": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_manifest": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_bytes": 0, 2026-02-17T12:52:55.508 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_keys": 0, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_repaired": 0 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "store_stats": { 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "total": 0, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "available": 0, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 0, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 0, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 0, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 0 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "log_size": 3, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "ondisk_log_size": 3, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "up": 4, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "acting": 4, 2026-02-17T12:52:55.509 INFO:tasks.workunit.client.0.trial155.stdout: "num_store_stats": 0 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "osd_sum": { 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "up_from": 0, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "seq": 0, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "num_pgs": 0, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "num_osds": 1, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_osds": 1, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_omap_osds": 1, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "kb": 104857600, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used": 27072, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_data": 88, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_omap": 1, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_meta": 26942, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "kb_avail": 104830528, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "statfs": { 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "total": 107374182400, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "available": 107346460672, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 90112, 2026-02-17T12:52:55.510 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 18425, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 1593, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 27589063 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "hb_peers": [], 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "snap_trim_queue_len": 0, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "num_snap_trimming": 0, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "num_shards_repaired": 0, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "op_queue_age_hist": { 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "histogram": [], 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "upper_bound": 1 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "perf_stat": { 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ms": 1, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ms": 1, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ns": 1000000, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ns": 1000000 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.511 INFO:tasks.workunit.client.0.trial155.stdout: "alerts": [], 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "network_ping_times": [] 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "osd_sum_by_class": { 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "ssd": { 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "up_from": 0, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "seq": 0, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "num_pgs": 0, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "num_osds": 1, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_osds": 1, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_omap_osds": 1, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "kb": 104857600, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used": 27072, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_data": 88, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_omap": 1, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_meta": 26942, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "kb_avail": 104830528, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "statfs": { 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "total": 107374182400, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "available": 107346460672, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:52:55.512 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 90112, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 18425, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 1593, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 27589063 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "hb_peers": [], 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "snap_trim_queue_len": 0, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "num_snap_trimming": 0, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "num_shards_repaired": 0, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "op_queue_age_hist": { 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "histogram": [], 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "upper_bound": 1 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "perf_stat": { 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ms": 1, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ms": 1, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ns": 1000000, 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ns": 1000000 2026-02-17T12:52:55.513 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "alerts": [], 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "network_ping_times": [] 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "pool_stats": [ 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "poolid": 1, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg": 4, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "stat_sum": { 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes": 19, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects": 2, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_clones": 0, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_copies": 4, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing": 0, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_degraded": 2, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_misplaced": 0, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_unfound": 0, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_dirty": 2, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_whiteouts": 0, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_read": 0, 2026-02-17T12:52:55.514 INFO:tasks.workunit.client.0.trial155.stdout: "num_read_kb": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_write": 2, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_write_kb": 2, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_scrub_errors": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_deep_scrub_errors": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_recovered": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_recovered": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_keys_recovered": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_omap": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_kb": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_kb": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_promote": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_high": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_low": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_some": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_full": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_pinned": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_legacy_snapsets": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_large_omap_objects": 0, 2026-02-17T12:52:55.515 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_manifest": 0, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_bytes": 0, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_keys": 0, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_repaired": 0 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "store_stats": { 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "total": 0, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "available": 0, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 4096, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 19, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 0, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 0 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "log_size": 3, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "ondisk_log_size": 3, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "up": 4, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "acting": 4, 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "num_store_stats": 1 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.516 INFO:tasks.workunit.client.0.trial155.stdout: "osd_stats": [ 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "seq": 21474836481 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_by_state": [ 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "state": "active+undersized+degraded", 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "num": 2 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "state": "active+undersized", 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "num": 2 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_by_osd": [ 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "num_primary_pg": 4, 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "num_acting_pg": 4, 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "num_up_not_acting_pg": 0 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.517 INFO:tasks.workunit.client.0.trial155.stdout: "purged_snaps": [ 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "pool": 1, 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "purged_snaps": {} 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "servicemap": { 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 1, 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "modified": "2026-02-17T12:52:39.520657+0000", 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "services": {} 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "mgrstat_first_committed": 1, 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "mgrstat_last_committed": 4, 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "logm_first_committed": 1, 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "logm_last_committed": 58, 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "paxos": { 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "first_committed": 1, 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "last_committed": 83, 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "last_pn": 0, 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: "accepted_pn": 0 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:52:55.518 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:52:55.520 INFO:tasks.workunit.client.0.trial155.stderr:report 40319306 2026-02-17T12:52:55.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1680: wait_for_clean: return 1 2026-02-17T12:52:55.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1699: test_wait_for_clean: run_osd td/ceph-helpers 1 2026-02-17T12:52:55.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:52:55.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:52:55.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:52:55.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/1 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:52:55.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/1 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=9528a6d9-797d-4978-8a46-433d8cb08042 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 9528a6d9-797d-4978-8a46-433d8cb08042' 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 9528a6d9-797d-4978-8a46-433d8cb08042 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCnZJRp7FyvHBAA2Loj39PNZXCyY7o35rfTww== 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCnZJRp7FyvHBAA2Loj39PNZXCyY7o35rfTww=="}' 2026-02-17T12:52:55.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 9528a6d9-797d-4978-8a46-433d8cb08042 -i td/ceph-helpers/1/new.json 2026-02-17T12:52:55.676 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:52:55.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/1/new.json 2026-02-17T12:52:55.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCnZJRp7FyvHBAA2Loj39PNZXCyY7o35rfTww== --osd-uuid 9528a6d9-797d-4978-8a46-433d8cb08042 2026-02-17T12:52:55.703 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:55.701+0000 7fa642525780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:55.704 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:55.702+0000 7fa642525780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:55.705 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:55.703+0000 7fa642525780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:55.706 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:55.703+0000 7fa642525780 -1 bdev(0x5645d6d8dc00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:52:55.706 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:55.704+0000 7fa642525780 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-17T12:52:57.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-17T12:52:57.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:52:57.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:52:57.820 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:52:57.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:52:58.089 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:52:58.090 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:52:58.090 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:52:58.090 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:52:58.091 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:52:58.091 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:52:58.106 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:58.104+0000 7fdf0e525780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:58.108 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:58.106+0000 7fdf0e525780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:58.109 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:58.106+0000 7fdf0e525780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:52:58.282 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:52:58.282 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:52:58.283 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:52:58.283 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:52:58.283 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:52:58.283 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:58.283 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:52:58.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:52:58.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:58.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:52:58.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:59.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:52:59.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:52:59.489 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:52:59.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:52:59.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:52:59.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:52:59.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:52:59.699 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:52:59.697+0000 7fdf0e525780 -1 Falling back to public interface 2026-02-17T12:53:00.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:00.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:00.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:53:00.679 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:53:00.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:00.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:00.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:01.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:01.868 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:53:01.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:53:01.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:01.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:02.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:02.412 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:02.409+0000 7fdf0e525780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:53:03.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:03.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:03.057 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:53:03.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:53:03.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:03.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:03.247 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 16 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4251761675,v1:127.0.0.1:6811/4251761675] [v2:127.0.0.1:6812/4251761675,v1:127.0.0.1:6813/4251761675] exists,up 9528a6d9-797d-4978-8a46-433d8cb08042 2026-02-17T12:53:03.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:53:03.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:53:03.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:53:03.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: test_wait_for_clean: wait_for_clean 2026-02-17T12:53:03.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:53:03.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:53:03.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:53:03.249 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:53:03.250 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:53:03.250 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:53:03.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:53:03.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:53:03.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:53:03.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:53:03.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:53:03.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:53:03.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:53:03.333 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:53:03.333 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:53:03.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:53:03.528 INFO:tasks.workunit.client.0.trial155.stderr:1' 2026-02-17T12:53:03.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:53:03.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:53:03.528 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:53:03.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836485 2026-02-17T12:53:03.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836485 2026-02-17T12:53:03.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T12:53:03.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:53:03.592 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:53:03.656 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=68719476739 2026-02-17T12:53:03.656 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 68719476739 2026-02-17T12:53:03.656 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836485 1-68719476739' 2026-02-17T12:53:03.656 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:53:03.657 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836485 2026-02-17T12:53:03.657 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:53:03.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:53:03.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836485 2026-02-17T12:53:03.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:53:03.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836485 2026-02-17T12:53:03.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T12:53:03.660 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836485 2026-02-17T12:53:03.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:53:03.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T12:53:03.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:53:03.846 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-68719476739 2026-02-17T12:53:03.846 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:53:03.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:53:03.848 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-68719476739 2026-02-17T12:53:03.848 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:53:03.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=68719476739 2026-02-17T12:53:03.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 68719476739' 2026-02-17T12:53:03.849 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 68719476739 2026-02-17T12:53:03.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:53:04.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 68719476739 -lt 68719476739 2026-02-17T12:53:04.051 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:53:04.051 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:53:04.051 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:53:04.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:53:04.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:53:04.312 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:53:04.312 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:53:04.312 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:53:04.312 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:53:04.312 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:53:04.312 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:53:04.498 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:53:04.499 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:53:04.499 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:53:04.499 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:53:04.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:53:04.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' -1 2026-02-17T12:53:04.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T12:53:04.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=0 2026-02-17T12:53:04.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:53:04.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T12:53:04.848 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:53:04.848 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:53:04.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:53:04.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:53:04.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:53:04.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:53:04.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:53:04.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:53:05.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:53:05.034 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:53:05.034 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:53:05.034 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:53:05.285 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:53:05.285 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:53:05.285 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:53:05.285 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:53:05.286 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:53:05.286 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:53:05.286 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:53:05.287 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:53:05.287 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:53:05.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:53:05.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:53:05.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 1 >= 13 )) 2026-02-17T12:53:05.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:53:05.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.2 2026-02-17T12:53:05.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:53:05.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:53:05.735 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:53:05.735 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:53:05.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:53:05.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:53:05.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:53:05.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:53:05.920 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:53:05.921 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:53:05.921 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:53:05.921 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:53:06.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:53:06.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:53:06.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:53:06.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:53:06.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:53:06.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:53:06.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:53:06.181 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:53:06.181 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:53:06.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:53:06.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:53:06.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 2 >= 13 )) 2026-02-17T12:53:06.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:53:06.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.4 2026-02-17T12:53:06.840 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:53:06.840 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:53:06.840 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:53:06.840 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:53:06.840 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:53:06.841 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:53:06.841 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:53:06.841 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:53:07.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:53:07.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:53:07.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:53:07.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:53:07.283 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:53:07.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:53:07.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:53:07.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:53:07.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:53:07.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:53:07.284 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:53:07.284 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:53:07.284 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:53:07.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:53:07.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:53:07.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 3 >= 13 )) 2026-02-17T12:53:07.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:53:07.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.8 2026-02-17T12:53:08.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:53:08.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:53:08.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:53:08.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:53:08.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:53:08.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:53:08.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:53:08.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:53:08.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:53:08.533 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:53:08.534 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:53:08.534 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:53:08.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:53:08.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:53:08.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:53:08.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:53:08.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:53:08.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:53:08.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:53:08.788 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:53:08.788 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:53:09.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:53:09.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:53:09.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 4 >= 13 )) 2026-02-17T12:53:09.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:53:09.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 1.6 2026-02-17T12:53:10.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:53:10.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:53:10.637 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:53:10.638 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:53:10.638 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:53:10.638 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:53:10.638 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:53:10.638 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:53:10.830 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=2 2026-02-17T12:53:10.830 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:53:10.830 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:53:10.831 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:53:11.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 2 = 4 2026-02-17T12:53:11.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 2 '!=' 0 2026-02-17T12:53:11.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T12:53:11.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=2 2026-02-17T12:53:11.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:53:11.083 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T12:53:11.183 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:53:11.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:53:11.184 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:53:11.184 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:53:11.184 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:53:11.184 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:53:11.185 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:53:11.185 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:53:11.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=2 2026-02-17T12:53:11.369 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:53:11.369 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:53:11.369 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:53:11.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 2 = 4 2026-02-17T12:53:11.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 2 '!=' 2 2026-02-17T12:53:11.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:53:11.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:53:11.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:53:11.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:53:11.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:53:11.624 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:53:11.625 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:53:11.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=2 2026-02-17T12:53:11.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 2 '!=' null 2026-02-17T12:53:11.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1677: wait_for_clean: loop=0 2026-02-17T12:53:11.879 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:53:11.879 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T12:53:11.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:53:11.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:53:11.981 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:53:11.981 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:53:11.981 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:53:11.981 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:53:11.981 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:53:11.981 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:53:12.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:53:12.163 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:53:12.163 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:53:12.163 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:53:12.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:53:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:53:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:53:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1701: test_wait_for_clean: teardown td/ceph-helpers 2026-02-17T12:53:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:53:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:53:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:53:12.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:53:12.417 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:53:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:53:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:53:12.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:53:12.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:53:12.524 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:53:12.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:53:12.525 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:53:12.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:53:12.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:53:12.527 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:53:12.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:53:12.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:53:12.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:53:12.529 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:53:12.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:53:12.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:53:12.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:53:12.536 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:53:12.537 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:12.537 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:12.537 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:53:12.538 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_wait_for_health_ok td/ceph-helpers 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1863: test_wait_for_health_ok: local dir=td/ceph-helpers 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1865: test_wait_for_health_ok: setup td/ceph-helpers 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:53:12.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:53:12.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:53:12.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:53:12.540 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:53:12.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:53:12.541 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:53:12.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:53:12.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:53:12.542 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:53:12.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:53:12.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:53:12.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:53:12.543 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:53:12.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:53:12.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:53:12.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:53:12.546 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:53:12.546 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:12.546 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:12.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:53:12.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:53:12.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:53:12.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:53:12.548 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:53:12.548 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:12.548 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:12.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:53:12.549 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:53:12.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:53:12.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:53:12.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:53:12.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1866: test_wait_for_health_ok: run_mon td/ceph-helpers a --osd_failsafe_full_ratio=.99 --mon_pg_warn_min_per_osd=0 2026-02-17T12:53:12.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:53:12.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:53:12.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:53:12.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:53:12.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:53:12.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_failsafe_full_ratio=.99 --mon_pg_warn_min_per_osd=0 2026-02-17T12:53:12.571 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:53:12.571 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:53:12.571 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:53:12.571 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:53:12.571 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:12.571 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:12.571 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:12.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_failsafe_full_ratio=.99 --mon_pg_warn_min_per_osd=0 2026-02-17T12:53:12.597 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:53:12.598 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:53:12.598 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:53:12.598 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:53:12.598 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:53:12.598 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:53:12.599 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:53:12.599 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:53:12.599 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:53:12.599 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:53:12.599 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:12.599 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:12.599 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:53:12.599 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:53:12.599 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:53:12.643 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:53:12.643 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:53:12.644 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:53:12.644 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:53:12.644 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:53:12.644 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:53:12.644 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:53:12.644 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:53:12.645 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:53:12.645 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:12.645 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:12.645 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:53:12.645 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:53:12.645 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:53:12.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1867: test_wait_for_health_ok: run_mgr td/ceph-helpers x --mon_pg_warn_min_per_osd=0 2026-02-17T12:53:12.689 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:53:12.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:53:12.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:53:12.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:53:12.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:53:12.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:53:12.789 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:53:12.789 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:53:12.789 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:53:12.789 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:53:12.789 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:12.789 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:12.789 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:12.789 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:53:12.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mon_pg_warn_min_per_osd=0 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1869: test_wait_for_health_ok: run_osd td/ceph-helpers 0 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:12.809 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:12.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:12.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:53:12.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:53:12.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:53:12.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:53:12.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:53:12.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:53:12.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:53:12.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:53:12.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:53:12.810 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:53:12.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:53:12.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:53:12.811 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:53:12.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=85b539a4-2baa-4448-8f0d-9811268cb7ab 2026-02-17T12:53:12.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 85b539a4-2baa-4448-8f0d-9811268cb7ab' 2026-02-17T12:53:12.811 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 85b539a4-2baa-4448-8f0d-9811268cb7ab 2026-02-17T12:53:12.811 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:53:12.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC4ZJRpyJftMBAALr1xBgP9uYERRQ0K2vKVoQ== 2026-02-17T12:53:12.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC4ZJRpyJftMBAALr1xBgP9uYERRQ0K2vKVoQ=="}' 2026-02-17T12:53:12.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 85b539a4-2baa-4448-8f0d-9811268cb7ab -i td/ceph-helpers/0/new.json 2026-02-17T12:53:12.924 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:53:12.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:53:12.931 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC4ZJRpyJftMBAALr1xBgP9uYERRQ0K2vKVoQ== --osd-uuid 85b539a4-2baa-4448-8f0d-9811268cb7ab 2026-02-17T12:53:12.949 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:12.948+0000 7f80fd412780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:12.950 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:12.949+0000 7f80fd412780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:12.951 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:12.950+0000 7f80fd412780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:12.951 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:12.950+0000 7f80fd412780 -1 bdev(0x5638a01d1c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:53:12.951 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:12.950+0000 7f80fd412780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:53:15.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:53:15.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:53:15.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:53:15.352 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:53:15.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:53:15.609 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:53:15.610 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:53:15.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:53:15.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:53:15.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:53:15.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:53:15.626 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:15.625+0000 7f28af4d9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:15.627 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:15.626+0000 7f28af4d9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:15.628 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:15.627+0000 7f28af4d9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:15.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:53:15.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:53:15.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:53:15.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:53:15.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:53:15.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:15.801 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:53:15.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:53:15.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:15.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:53:15.989 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:16.990 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:16.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:16.991 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:53:16.992 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:53:16.992 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:16.992 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:53:17.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:17.211 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:17.209+0000 7f28af4d9780 -1 Falling back to public interface 2026-02-17T12:53:18.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:18.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:18.178 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:53:18.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:53:18.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:18.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:53:18.365 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:19.366 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:19.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:19.367 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:53:19.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:53:19.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:19.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:53:19.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:20.152 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:20.150+0000 7f28af4d9780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:53:20.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:20.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:20.561 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:53:20.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:53:20.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:20.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:53:20.757 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3837966632,v1:127.0.0.1:6803/3837966632] [v2:127.0.0.1:6804/3837966632,v1:127.0.0.1:6805/3837966632] exists,up 85b539a4-2baa-4448-8f0d-9811268cb7ab 2026-02-17T12:53:20.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:53:20.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:53:20.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:53:20.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1870: test_wait_for_health_ok: run_osd td/ceph-helpers 1 2026-02-17T12:53:20.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:53:20.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:53:20.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:53:20.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:53:20.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/1 2026-02-17T12:53:20.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:53:20.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:53:20.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:53:20.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:53:20.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-17T12:53:20.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-17T12:53:20.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:53:20.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:53:20.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:53:20.765 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:53:20.765 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:53:20.765 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:53:20.765 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:53:20.765 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:20.765 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:20.765 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:20.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:20.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:53:20.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:53:20.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:53:20.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:53:20.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:53:20.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:53:20.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:53:20.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:53:20.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:53:20.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:53:20.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:53:20.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/1 2026-02-17T12:53:20.767 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:53:20.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=458c3a7b-9fcb-47ed-9ad8-44d500ab0e08 2026-02-17T12:53:20.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 458c3a7b-9fcb-47ed-9ad8-44d500ab0e08' 2026-02-17T12:53:20.768 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 458c3a7b-9fcb-47ed-9ad8-44d500ab0e08 2026-02-17T12:53:20.768 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:53:20.773 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDAZJRpu4T7LRAAZo8HT2EsQCSMXbF3GTsxGw== 2026-02-17T12:53:20.773 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDAZJRpu4T7LRAAZo8HT2EsQCSMXbF3GTsxGw=="}' 2026-02-17T12:53:20.773 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 458c3a7b-9fcb-47ed-9ad8-44d500ab0e08 -i td/ceph-helpers/1/new.json 2026-02-17T12:53:20.963 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:53:20.970 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/1/new.json 2026-02-17T12:53:20.971 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDAZJRpu4T7LRAAZo8HT2EsQCSMXbF3GTsxGw== --osd-uuid 458c3a7b-9fcb-47ed-9ad8-44d500ab0e08 2026-02-17T12:53:20.988 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:20.986+0000 7ff795c19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:20.989 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:20.988+0000 7ff795c19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:20.990 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:20.989+0000 7ff795c19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:20.990 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:20.989+0000 7ff795c19780 -1 bdev(0x557ab951fc00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:53:20.990 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:20.989+0000 7ff795c19780 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-17T12:53:23.101 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-17T12:53:23.102 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:53:23.102 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:53:23.103 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:53:23.103 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:53:23.357 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:53:23.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:53:23.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:53:23.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:53:23.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:53:23.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:53:23.374 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:23.373+0000 7f1fd3425780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:23.375 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:23.374+0000 7f1fd3425780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:23.376 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:23.375+0000 7f1fd3425780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:23.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:53:23.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:53:23.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:53:23.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:53:23.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:53:23.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:23.545 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:53:23.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:53:23.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:23.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:23.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:24.717 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:24.715+0000 7f1fd3425780 -1 Falling back to public interface 2026-02-17T12:53:24.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:24.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:24.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:53:24.738 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:53:24.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:24.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:24.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:25.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:25.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:25.928 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:53:25.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:53:25.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:25.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:26.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:27.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:27.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:27.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:53:27.117 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:53:27.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:27.117 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:27.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:27.685 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:27.683+0000 7f1fd3425780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:53:28.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:28.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:28.308 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:53:28.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:53:28.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:28.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:28.499 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3760282566,v1:127.0.0.1:6811/3760282566] [v2:127.0.0.1:6812/3760282566,v1:127.0.0.1:6813/3760282566] exists,up 458c3a7b-9fcb-47ed-9ad8-44d500ab0e08 2026-02-17T12:53:28.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:53:28.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:53:28.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:53:28.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1871: test_wait_for_health_ok: run_osd td/ceph-helpers 2 2026-02-17T12:53:28.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:53:28.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/2 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:53:28.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:53:28.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:53:28.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:53:28.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:53:28.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:53:28.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:53:28.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:53:28.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:53:28.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/2 2026-02-17T12:53:28.506 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:53:28.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=83435a74-1dfd-4d65-8607-dfb7cf3fcd34 2026-02-17T12:53:28.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 83435a74-1dfd-4d65-8607-dfb7cf3fcd34' 2026-02-17T12:53:28.507 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 83435a74-1dfd-4d65-8607-dfb7cf3fcd34 2026-02-17T12:53:28.507 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:53:28.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDIZJRp8i2mHhAAEjSHQq0aHJCJMzbsQU+3DA== 2026-02-17T12:53:28.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDIZJRp8i2mHhAAEjSHQq0aHJCJMzbsQU+3DA=="}' 2026-02-17T12:53:28.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 83435a74-1dfd-4d65-8607-dfb7cf3fcd34 -i td/ceph-helpers/2/new.json 2026-02-17T12:53:28.710 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:53:28.717 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/2/new.json 2026-02-17T12:53:28.718 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDIZJRp8i2mHhAAEjSHQq0aHJCJMzbsQU+3DA== --osd-uuid 83435a74-1dfd-4d65-8607-dfb7cf3fcd34 2026-02-17T12:53:28.736 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:28.734+0000 7fafaac10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:28.737 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:28.736+0000 7fafaac10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:28.738 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:28.737+0000 7fafaac10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:28.739 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:28.737+0000 7fafaac10780 -1 bdev(0x564507787c00 td/ceph-helpers/2/block) open stat got: (1) Operation not permitted 2026-02-17T12:53:28.739 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:28.738+0000 7fafaac10780 -1 bluestore(td/ceph-helpers/2) _read_fsid unparsable uuid 2026-02-17T12:53:30.856 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/2/keyring 2026-02-17T12:53:30.856 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:53:30.857 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:53:30.858 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:53:30.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:53:31.110 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:53:31.111 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:53:31.112 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:53:31.112 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:53:31.112 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:53:31.112 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:53:31.127 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:31.125+0000 7efddd411780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:31.128 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:31.127+0000 7efddd411780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:31.129 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:31.128+0000 7efddd411780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:31.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:53:31.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:53:31.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:53:31.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:53:31.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:53:31.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:31.300 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:53:31.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:53:31.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:31.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:53:31.486 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:32.469 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:32.468+0000 7efddd411780 -1 Falling back to public interface 2026-02-17T12:53:32.487 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:32.487 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:32.488 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:53:32.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:53:32.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:32.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:53:32.675 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:33.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:33.677 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:33.677 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:53:33.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:53:33.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:33.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:53:33.872 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:34.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:34.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:34.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:53:34.874 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:53:34.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:34.874 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:53:35.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:35.403 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:35.401+0000 7efddd411780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:53:36.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:36.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:36.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:53:36.065 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:53:36.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:36.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:53:36.255 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3229497361,v1:127.0.0.1:6819/3229497361] [v2:127.0.0.1:6820/3229497361,v1:127.0.0.1:6821/3229497361] exists,up 83435a74-1dfd-4d65-8607-dfb7cf3fcd34 2026-02-17T12:53:36.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:53:36.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:53:36.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:53:36.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1872: test_wait_for_health_ok: kill_daemons td/ceph-helpers TERM osd 2026-02-17T12:53:36.257 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:53:36.257 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:53:36.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:53:36.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:53:36.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:53:37.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:53:37.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1873: test_wait_for_health_ok: ceph osd down 0 2026-02-17T12:53:37.756 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 is already down. 2026-02-17T12:53:37.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1875: test_wait_for_health_ok: TIMEOUT=1 2026-02-17T12:53:37.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1875: test_wait_for_health_ok: wait_for_health_ok 2026-02-17T12:53:37.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1859: wait_for_health_ok: wait_for_health HEALTH_OK 2026-02-17T12:53:37.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: wait_for_health: local grepstr=HEALTH_OK 2026-02-17T12:53:37.763 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1839: wait_for_health: get_timeout_delays 1 .1 2026-02-17T12:53:37.764 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:53:37.764 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:53:37.764 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:53:37.764 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:53:37.765 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:53:37.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1839: wait_for_health: delays=('0.1' '0.2' '0.4' '0.3') 2026-02-17T12:53:37.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1839: wait_for_health: local -a delays 2026-02-17T12:53:37.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1840: wait_for_health: local -i loop=0 2026-02-17T12:53:37.790 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: grep HEALTH_OK 2026-02-17T12:53:37.791 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: ceph health detail 2026-02-17T12:53:38.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1843: wait_for_health: (( 0 >= 4 )) 2026-02-17T12:53:38.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1847: wait_for_health: sleep 0.1 2026-02-17T12:53:38.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: wait_for_health: loop+=1 2026-02-17T12:53:38.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: ceph health detail 2026-02-17T12:53:38.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: grep HEALTH_OK 2026-02-17T12:53:38.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1843: wait_for_health: (( 1 >= 4 )) 2026-02-17T12:53:38.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1847: wait_for_health: sleep 0.2 2026-02-17T12:53:38.593 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: wait_for_health: loop+=1 2026-02-17T12:53:38.593 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: ceph health detail 2026-02-17T12:53:38.594 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: grep HEALTH_OK 2026-02-17T12:53:38.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1843: wait_for_health: (( 2 >= 4 )) 2026-02-17T12:53:38.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1847: wait_for_health: sleep 0.4 2026-02-17T12:53:39.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: wait_for_health: loop+=1 2026-02-17T12:53:39.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: ceph health detail 2026-02-17T12:53:39.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: grep HEALTH_OK 2026-02-17T12:53:39.498 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1843: wait_for_health: (( 3 >= 4 )) 2026-02-17T12:53:39.498 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1847: wait_for_health: sleep 0.3 2026-02-17T12:53:39.799 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: wait_for_health: loop+=1 2026-02-17T12:53:39.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: ceph health detail 2026-02-17T12:53:39.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: grep HEALTH_OK 2026-02-17T12:53:40.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1843: wait_for_health: (( 4 >= 4 )) 2026-02-17T12:53:40.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: wait_for_health: ceph health detail 2026-02-17T12:53:40.304 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN 3 osds down; 1 host (3 osds) down; 1 root (3 osds) down 2026-02-17T12:53:40.304 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_DOWN: 3 osds down 2026-02-17T12:53:40.304 INFO:tasks.workunit.client.0.trial155.stdout: osd.0 (root=default,host=trial155) is down 2026-02-17T12:53:40.305 INFO:tasks.workunit.client.0.trial155.stdout: osd.1 (root=default,host=trial155) is down 2026-02-17T12:53:40.305 INFO:tasks.workunit.client.0.trial155.stdout: osd.2 (root=default,host=trial155) is down 2026-02-17T12:53:40.305 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_HOST_DOWN: 1 host (3 osds) down 2026-02-17T12:53:40.305 INFO:tasks.workunit.client.0.trial155.stdout: host trial155 (root=default) (3 osds) is down 2026-02-17T12:53:40.305 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_ROOT_DOWN: 1 root (3 osds) down 2026-02-17T12:53:40.305 INFO:tasks.workunit.client.0.trial155.stdout: root default (3 osds) is down 2026-02-17T12:53:40.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1845: wait_for_health: return 1 2026-02-17T12:53:40.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1859: wait_for_health_ok: return 1 2026-02-17T12:53:40.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: test_wait_for_health_ok: activate_osd td/ceph-helpers 0 2026-02-17T12:53:40.314 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ceph-helpers 2026-02-17T12:53:40.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:53:40.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T12:53:40.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:53:40.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:53:40.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:53:40.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:53:40.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:53:40.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:53:40.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:53:40.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:53:40.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:53:40.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:53:40.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:53:40.316 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:53:40.316 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:53:40.316 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:53:40.316 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:53:40.316 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:40.316 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:40.316 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:40.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:40.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:53:40.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:53:40.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:53:40.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:53:40.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:53:40.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:53:40.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:53:40.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:53:40.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:53:40.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:53:40.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T12:53:40.318 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:53:40.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:53:40.319 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ceph-helpers/0/whoami 2026-02-17T12:53:40.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T12:53:40.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:53:40.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:53:40.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:53:40.329 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:40.327+0000 7fd1b10d9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:40.330 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:40.329+0000 7fd1b10d9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:40.331 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:40.330+0000 7fd1b10d9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:40.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T12:53:40.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:53:40.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:53:40.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:53:40.503 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:53:40.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:40.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:53:40.504 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:53:40.504 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:40.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:53:40.690 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:41.416 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:41.415+0000 7fd1b10d9780 -1 Falling back to public interface 2026-02-17T12:53:41.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:41.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:41.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:53:41.692 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:53:41.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:41.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:53:41.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:42.891 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:42.891 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:42.892 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:53:42.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:53:42.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:42.892 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:53:43.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:44.080 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:44.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:44.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:53:44.081 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:53:44.081 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:44.082 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:53:44.130 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:44.129+0000 7fd1b10d9780 -1 osd.0 13 log_to_monitors true 2026-02-17T12:53:44.273 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:45.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:45.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:45.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:53:45.275 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:53:45.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:45.276 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:53:45.465 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 17 up_thru 0 down_at 15 last_clean_interval [5,13) [v2:127.0.0.1:6802/3239887107,v1:127.0.0.1:6803/3239887107] [v2:127.0.0.1:6804/3239887107,v1:127.0.0.1:6805/3239887107] exists,up 85b539a4-2baa-4448-8f0d-9811268cb7ab 2026-02-17T12:53:45.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:53:45.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:53:45.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:53:45.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: test_wait_for_health_ok: activate_osd td/ceph-helpers 1 2026-02-17T12:53:45.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ceph-helpers 2026-02-17T12:53:45.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:53:45.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T12:53:45.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:53:45.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ceph-helpers/1 2026-02-17T12:53:45.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:53:45.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:53:45.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:53:45.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:53:45.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:45.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:45.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:53:45.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:53:45.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:53:45.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:53:45.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:53:45.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:53:45.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:53:45.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:53:45.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:53:45.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ceph-helpers/1 2026-02-17T12:53:45.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T12:53:45.472 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:53:45.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:53:45.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ceph-helpers/1/whoami 2026-02-17T12:53:45.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T12:53:45.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:53:45.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:53:45.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:53:45.484 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:45.482+0000 7f588098f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:45.485 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:45.484+0000 7f588098f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:45.486 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:45.485+0000 7f588098f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:45.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T12:53:45.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:53:45.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:53:45.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:53:45.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:53:45.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:45.657 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:53:45.657 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:53:45.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:45.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:45.851 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:46.826 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:46.824+0000 7f588098f780 -1 Falling back to public interface 2026-02-17T12:53:46.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:46.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:46.852 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:53:46.852 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:53:46.853 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:46.853 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:47.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:48.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:48.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:48.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:53:48.043 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:53:48.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:48.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:48.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:49.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:49.235 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:49.236 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:53:49.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:53:49.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:49.237 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:49.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:49.521 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:49.519+0000 7f588098f780 -1 osd.1 14 log_to_monitors true 2026-02-17T12:53:50.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:50.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:50.431 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:53:50.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:53:50.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:50.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:53:50.624 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 19 up_thru 0 down_at 15 last_clean_interval [10,14) [v2:127.0.0.1:6810/2649550222,v1:127.0.0.1:6811/2649550222] [v2:127.0.0.1:6812/2649550222,v1:127.0.0.1:6813/2649550222] exists,up 458c3a7b-9fcb-47ed-9ad8-44d500ab0e08 2026-02-17T12:53:50.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:53:50.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:53:50.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:53:50.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: test_wait_for_health_ok: activate_osd td/ceph-helpers 2 2026-02-17T12:53:50.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ceph-helpers 2026-02-17T12:53:50.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:53:50.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T12:53:50.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:53:50.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ceph-helpers/2 2026-02-17T12:53:50.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:53:50.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:53:50.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:53:50.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:53:50.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2026-02-17T12:53:50.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2026-02-17T12:53:50.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:53:50.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:53:50.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:53:50.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:53:50.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:53:50.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:53:50.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:53:50.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:53:50.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:53:50.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ceph-helpers/2 2026-02-17T12:53:50.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T12:53:50.632 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:53:50.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:53:50.633 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ceph-helpers/2/whoami 2026-02-17T12:53:50.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T12:53:50.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:53:50.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:53:50.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:53:50.644 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:50.642+0000 7f3926422780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:50.645 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:50.644+0000 7f3926422780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:50.646 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:50.645+0000 7f3926422780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:50.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T12:53:50.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:53:50.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:53:50.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:53:50.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:53:50.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:50.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:53:50.816 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:53:50.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:50.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:53:51.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:51.985 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:51.984+0000 7f3926422780 -1 Falling back to public interface 2026-02-17T12:53:52.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:52.007 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:52.007 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:53:52.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:53:52.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:52.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:53:52.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:53.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:53.198 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:53.198 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:53:53.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:53:53.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:53.199 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:53:53.399 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:54.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:54.400 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:54.401 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:53:54.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:53:54.401 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:54.402 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:53:54.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:53:54.674 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:54.673+0000 7f3926422780 -1 osd.2 14 log_to_monitors true 2026-02-17T12:53:55.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:53:55.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:55.589 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:53:55.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:53:55.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:55.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:53:55.784 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 22 up_thru 0 down_at 15 last_clean_interval [0,0) [v2:127.0.0.1:6818/2500264895,v1:127.0.0.1:6819/2500264895] [v2:127.0.0.1:6820/2500264895,v1:127.0.0.1:6821/2500264895] exists,up 83435a74-1dfd-4d65-8607-dfb7cf3fcd34 2026-02-17T12:53:55.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:53:55.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:53:55.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:53:55.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1880: test_wait_for_health_ok: wait_for_health_ok 2026-02-17T12:53:55.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1859: wait_for_health_ok: wait_for_health HEALTH_OK 2026-02-17T12:53:55.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: wait_for_health: local grepstr=HEALTH_OK 2026-02-17T12:53:55.786 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1839: wait_for_health: get_timeout_delays 300 .1 2026-02-17T12:53:55.786 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:53:55.786 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:53:55.786 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:53:55.786 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:53:55.786 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:53:55.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1839: wait_for_health: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2026-02-17T12:53:55.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1839: wait_for_health: local -a delays 2026-02-17T12:53:55.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1840: wait_for_health: local -i loop=0 2026-02-17T12:53:55.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: ceph health detail 2026-02-17T12:53:55.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1842: wait_for_health: grep HEALTH_OK 2026-02-17T12:53:56.212 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_OK 2026-02-17T12:53:56.213 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: test_wait_for_health_ok: teardown td/ceph-helpers 2026-02-17T12:53:56.213 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:53:56.214 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:53:56.214 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:53:56.214 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:53:56.214 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:53:56.214 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:53:56.214 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:53:56.214 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:53:56.321 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:53:56.321 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:53:56.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:53:56.322 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:53:56.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:53:56.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:53:56.324 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:53:56.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:53:56.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:53:56.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:53:56.326 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:53:56.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:53:56.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:53:56.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:53:56.334 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:53:56.335 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:56.335 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:56.335 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:53:56.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:53:56.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:53:56.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:53:56.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_wait_for_osd td/ceph-helpers 2026-02-17T12:53:56.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:995: test_wait_for_osd: local dir=td/ceph-helpers 2026-02-17T12:53:56.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:996: test_wait_for_osd: setup td/ceph-helpers 2026-02-17T12:53:56.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:53:56.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:53:56.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:53:56.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:53:56.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:53:56.338 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:53:56.338 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:53:56.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:53:56.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:53:56.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:53:56.338 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:53:56.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:53:56.339 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:53:56.339 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:53:56.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:53:56.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:53:56.340 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:53:56.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:53:56.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:53:56.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:53:56.341 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:53:56.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:53:56.343 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:53:56.343 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:53:56.344 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:53:56.344 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:56.344 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:56.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:53:56.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:53:56.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:53:56.345 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:53:56.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:53:56.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:56.346 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:56.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:53:56.347 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:53:56.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:53:56.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:53:56.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:53:56.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:997: test_wait_for_osd: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:53:56.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:53:56.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:53:56.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:53:56.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:53:56.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:53:56.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:53:56.368 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:53:56.368 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:53:56.368 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:53:56.368 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:53:56.368 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:56.369 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:56.369 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:56.369 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:53:56.394 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:53:56.395 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:53:56.395 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:53:56.396 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:53:56.396 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:53:56.396 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:53:56.397 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:53:56.397 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:53:56.397 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:53:56.397 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:53:56.397 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:56.397 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:56.397 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:53:56.398 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:53:56.398 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:53:56.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:53:56.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:53:56.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:53:56.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:53:56.444 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:53:56.445 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:53:56.445 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:53:56.445 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:53:56.445 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:53:56.445 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:56.445 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:56.445 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:53:56.445 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:53:56.445 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:53:56.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:998: test_wait_for_osd: run_mgr td/ceph-helpers x 2026-02-17T12:53:56.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:53:56.488 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:53:56.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:53:56.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:53:56.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:53:56.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:53:56.590 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:53:56.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:53:56.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:53:56.591 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:53:56.591 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:56.591 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:56.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:56.592 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:53:56.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:53:56.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:999: test_wait_for_osd: run_osd td/ceph-helpers 0 2026-02-17T12:53:56.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:53:56.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:53:56.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:53:56.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:53:56.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:53:56.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:53:56.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:53:56.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:53:56.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:53:56.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:53:56.614 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:53:56.614 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:53:56.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b2d31751-e0bc-4097-b8b2-2920e7504c2d 2026-02-17T12:53:56.615 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 b2d31751-e0bc-4097-b8b2-2920e7504c2d' 2026-02-17T12:53:56.615 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 b2d31751-e0bc-4097-b8b2-2920e7504c2d 2026-02-17T12:53:56.615 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:53:56.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDkZJRpw2EhJRAA1AH7od9ktbr9FZq/yHl9XA== 2026-02-17T12:53:56.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDkZJRpw2EhJRAA1AH7od9ktbr9FZq/yHl9XA=="}' 2026-02-17T12:53:56.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b2d31751-e0bc-4097-b8b2-2920e7504c2d -i td/ceph-helpers/0/new.json 2026-02-17T12:53:56.728 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:53:56.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:53:56.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDkZJRpw2EhJRAA1AH7od9ktbr9FZq/yHl9XA== --osd-uuid b2d31751-e0bc-4097-b8b2-2920e7504c2d 2026-02-17T12:53:56.754 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:56.753+0000 7f8b0a60c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:56.755 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:56.754+0000 7f8b0a60c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:56.756 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:56.755+0000 7f8b0a60c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:56.757 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:56.755+0000 7f8b0a60c780 -1 bdev(0x55687d435c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:53:56.757 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:56.755+0000 7f8b0a60c780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:53:59.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:53:59.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:53:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:53:59.171 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:53:59.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:53:59.431 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:53:59.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:53:59.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:53:59.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:53:59.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:53:59.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:53:59.448 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:59.447+0000 7f18c980e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:59.450 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:59.448+0000 7f18c980e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:59.450 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:53:59.449+0000 7f18c980e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:53:59.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:53:59.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:53:59.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:53:59.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:53:59.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:53:59.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:53:59.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:53:59.625 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:53:59.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:53:59.625 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:53:59.811 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:00.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:00.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:00.812 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:54:00.813 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:54:00.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:00.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:01.002 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:01.031 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:01.029+0000 7f18c980e780 -1 Falling back to public interface 2026-02-17T12:54:02.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:02.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:02.003 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:54:02.004 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:54:02.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:02.004 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:02.195 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:03.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:03.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:03.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:54:03.197 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:54:03.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:03.198 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:03.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:03.971 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:03.970+0000 7f18c980e780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:54:04.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:04.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:04.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:54:04.390 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:54:04.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:04.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:04.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:05.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:05.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:05.581 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:54:05.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:54:05.582 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:05.582 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:05.773 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/251009919,v1:127.0.0.1:6803/251009919] [v2:127.0.0.1:6804/251009919,v1:127.0.0.1:6805/251009919] exists,up b2d31751-e0bc-4097-b8b2-2920e7504c2d 2026-02-17T12:54:05.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:54:05.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:54:05.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1000: test_wait_for_osd: run_osd td/ceph-helpers 1 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/1 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-17T12:54:05.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:05.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/1 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:54:05.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=aad346f4-5c6f-4f36-8be8-a10a833a1062 2026-02-17T12:54:05.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 aad346f4-5c6f-4f36-8be8-a10a833a1062' 2026-02-17T12:54:05.781 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 aad346f4-5c6f-4f36-8be8-a10a833a1062 2026-02-17T12:54:05.781 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:54:05.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDtZJRp9r/0LhAAdqAceLlM5kZ9kX8qkCyOGg== 2026-02-17T12:54:05.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDtZJRp9r/0LhAAdqAceLlM5kZ9kX8qkCyOGg=="}' 2026-02-17T12:54:05.789 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new aad346f4-5c6f-4f36-8be8-a10a833a1062 -i td/ceph-helpers/1/new.json 2026-02-17T12:54:05.983 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:54:05.990 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/1/new.json 2026-02-17T12:54:05.992 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDtZJRp9r/0LhAAdqAceLlM5kZ9kX8qkCyOGg== --osd-uuid aad346f4-5c6f-4f36-8be8-a10a833a1062 2026-02-17T12:54:06.009 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:06.008+0000 7f6be8d91780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:06.011 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:06.009+0000 7f6be8d91780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:06.012 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:06.010+0000 7f6be8d91780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:06.012 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:06.011+0000 7f6be8d91780 -1 bdev(0x564e0a1d9c00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:54:06.012 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:06.011+0000 7f6be8d91780 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-17T12:54:08.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-17T12:54:08.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:54:08.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:54:08.131 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:54:08.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:54:08.390 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:54:08.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:54:08.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:54:08.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:54:08.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:54:08.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:54:08.406 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:08.405+0000 7fcea6c1a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:08.408 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:08.406+0000 7fcea6c1a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:08.408 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:08.407+0000 7fcea6c1a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:08.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:54:08.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:54:08.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:54:08.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:54:08.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:54:08.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:08.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:54:08.588 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:54:08.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:08.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:08.775 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:09.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:09.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:09.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:54:09.778 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:54:09.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:09.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:09.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:10.003 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:10.001+0000 7fcea6c1a780 -1 Falling back to public interface 2026-02-17T12:54:10.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:10.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:10.967 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:54:10.967 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:54:10.967 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:10.968 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:11.162 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:12.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:12.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:12.164 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:54:12.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:54:12.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:12.165 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:12.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:12.950 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:12.948+0000 7fcea6c1a780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:54:13.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:13.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:13.356 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:54:13.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:54:13.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:13.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:13.554 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1274748756,v1:127.0.0.1:6811/1274748756] [v2:127.0.0.1:6812/1274748756,v1:127.0.0.1:6813/1274748756] exists,up aad346f4-5c6f-4f36-8be8-a10a833a1062 2026-02-17T12:54:13.555 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:54:13.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:54:13.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:54:13.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1001: test_wait_for_osd: wait_for_osd up 0 2026-02-17T12:54:13.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:54:13.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:54:13.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:54:13.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:54:13.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:13.556 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:54:13.557 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:54:13.557 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:13.557 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:13.742 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/251009919,v1:127.0.0.1:6803/251009919] [v2:127.0.0.1:6804/251009919,v1:127.0.0.1:6805/251009919] exists,up b2d31751-e0bc-4097-b8b2-2920e7504c2d 2026-02-17T12:54:13.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:54:13.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:54:13.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:54:13.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1002: test_wait_for_osd: wait_for_osd up 1 2026-02-17T12:54:13.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:54:13.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:54:13.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:54:13.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:54:13.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:13.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:54:13.744 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:54:13.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:13.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:13.939 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1274748756,v1:127.0.0.1:6811/1274748756] [v2:127.0.0.1:6812/1274748756,v1:127.0.0.1:6813/1274748756] exists,up aad346f4-5c6f-4f36-8be8-a10a833a1062 2026-02-17T12:54:13.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:54:13.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:54:13.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:54:13.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1003: test_wait_for_osd: kill_daemons td/ceph-helpers TERM osd.0 2026-02-17T12:54:13.941 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:54:13.941 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:54:13.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:54:13.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:54:13.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:54:15.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:54:15.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1004: test_wait_for_osd: wait_for_osd down 0 2026-02-17T12:54:15.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=down 2026-02-17T12:54:15.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:54:15.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:54:15.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:54:15.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:15.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:54:15.250 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:54:15.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:15.250 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 down' 2026-02-17T12:54:15.438 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 down in weight 1 up_from 5 up_thru 0 down_at 10 last_clean_interval [0,0) [v2:127.0.0.1:6802/251009919,v1:127.0.0.1:6803/251009919] [v2:127.0.0.1:6804/251009919,v1:127.0.0.1:6805/251009919] exists b2d31751-e0bc-4097-b8b2-2920e7504c2d 2026-02-17T12:54:15.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:54:15.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:54:15.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:54:15.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1005: test_wait_for_osd: TIMEOUT=1 2026-02-17T12:54:15.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1005: test_wait_for_osd: wait_for_osd up 0 2026-02-17T12:54:15.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:54:15.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:54:15.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:54:15.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:54:15.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 1 )) 2026-02-17T12:54:15.440 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:54:15.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:54:15.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:15.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:15.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:16.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:16.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 1 )) 2026-02-17T12:54:16.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 1 2026-02-17T12:54:16.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: test_wait_for_osd: teardown td/ceph-helpers 2026-02-17T12:54:16.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:54:16.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:54:16.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:54:16.639 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:54:16.639 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:54:16.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:54:16.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:54:16.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:54:16.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:54:16.745 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:54:16.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:54:16.747 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:54:16.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:54:16.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:54:16.748 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:54:16.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:54:16.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:54:16.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:54:16.750 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:54:16.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:54:16.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:54:16.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:54:16.756 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:54:16.757 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:16.757 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:16.757 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:54:16.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:54:16.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:54:16.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:54:16.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_wait_for_peered td/ceph-helpers 2026-02-17T12:54:16.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1775: test_wait_for_peered: local dir=td/ceph-helpers 2026-02-17T12:54:16.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1777: test_wait_for_peered: setup td/ceph-helpers 2026-02-17T12:54:16.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:54:16.759 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:54:16.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:54:16.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:54:16.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:54:16.760 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:54:16.760 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:54:16.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:54:16.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:54:16.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:54:16.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:54:16.761 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:54:16.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:54:16.761 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:54:16.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:54:16.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:54:16.762 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:54:16.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:54:16.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:54:16.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:54:16.764 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:54:16.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:54:16.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:54:16.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:54:16.766 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:54:16.767 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:16.767 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:16.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:54:16.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:54:16.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:54:16.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:54:16.769 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:54:16.769 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:16.769 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:16.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:54:16.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:54:16.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:54:16.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:54:16.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:54:16.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1778: test_wait_for_peered: run_mon td/ceph-helpers a --osd_pool_default_size=2 2026-02-17T12:54:16.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:54:16.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:54:16.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:54:16.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:54:16.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:54:16.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2026-02-17T12:54:16.790 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:54:16.790 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:54:16.790 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:54:16.790 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:54:16.791 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:16.791 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:16.791 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:16.791 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T12:54:16.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:54:16.817 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:54:16.817 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:54:16.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:54:16.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:54:16.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:54:16.819 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:54:16.819 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:54:16.819 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:54:16.819 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:54:16.819 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:16.819 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:16.819 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:54:16.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:54:16.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:54:16.863 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:54:16.864 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:54:16.864 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:54:16.864 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:54:16.864 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:54:16.865 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:54:16.865 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:54:16.865 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:54:16.865 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:54:16.865 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:16.866 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:16.866 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:54:16.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:54:16.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:54:16.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1779: test_wait_for_peered: run_osd td/ceph-helpers 0 2026-02-17T12:54:16.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:54:16.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:54:16.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:54:16.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:54:16.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:54:16.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:54:16.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:54:16.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:54:16.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:54:16.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:54:16.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:54:16.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:54:16.914 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:54:16.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2483ef95-2bd2-4053-a429-5985ba167d7d 2026-02-17T12:54:16.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 2483ef95-2bd2-4053-a429-5985ba167d7d' 2026-02-17T12:54:16.915 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 2483ef95-2bd2-4053-a429-5985ba167d7d 2026-02-17T12:54:16.915 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:54:16.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD4ZJRpNwr2NhAAtapTUbZJOSPsHGMMXkZlTQ== 2026-02-17T12:54:16.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD4ZJRpNwr2NhAAtapTUbZJOSPsHGMMXkZlTQ=="}' 2026-02-17T12:54:16.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2483ef95-2bd2-4053-a429-5985ba167d7d -i td/ceph-helpers/0/new.json 2026-02-17T12:54:17.024 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:54:17.030 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:54:17.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD4ZJRpNwr2NhAAtapTUbZJOSPsHGMMXkZlTQ== --osd-uuid 2483ef95-2bd2-4053-a429-5985ba167d7d 2026-02-17T12:54:17.048 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:17.047+0000 7f4123f10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:17.049 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:17.048+0000 7f4123f10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:17.050 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:17.049+0000 7f4123f10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:17.051 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:17.050+0000 7f4123f10780 -1 bdev(0x555e87569c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:54:17.051 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:17.050+0000 7f4123f10780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:54:19.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:54:19.415 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:54:19.416 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:54:19.416 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:54:19.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:54:19.518 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:54:19.519 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:54:19.519 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:54:19.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:54:19.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:54:19.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:54:19.535 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:19.534+0000 7fc0f2610780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:19.536 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:19.535+0000 7fc0f2610780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:19.537 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:19.536+0000 7fc0f2610780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:19.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:54:19.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:54:19.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:54:19.617 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:54:19.617 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:54:19.617 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:19.617 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:54:19.617 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:54:19.618 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:19.618 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:19.712 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:20.713 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:20.713 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:20.714 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:54:20.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:54:20.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:20.714 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:20.813 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:21.111 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:21.110+0000 7fc0f2610780 -1 Falling back to public interface 2026-02-17T12:54:21.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:21.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:21.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:54:21.816 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:54:21.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:21.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:21.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:22.916 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:22.916 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:22.916 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:54:22.916 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:54:22.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:22.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:23.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:24.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:24.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:24.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:54:24.014 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:54:24.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:24.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:24.093 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:24.092+0000 7fc0f2610780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:54:24.113 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:25.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:25.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:25.116 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:54:25.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:54:25.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:25.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:25.216 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2108857289,v1:127.0.0.1:6801/2108857289] [v2:127.0.0.1:6802/2108857289,v1:127.0.0.1:6803/2108857289] exists,up 2483ef95-2bd2-4053-a429-5985ba167d7d 2026-02-17T12:54:25.217 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:54:25.217 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:54:25.217 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:54:25.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1780: test_wait_for_peered: run_mgr td/ceph-helpers x 2026-02-17T12:54:25.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:54:25.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:54:25.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:54:25.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:54:25.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:54:25.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:54:25.317 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:54:25.317 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:54:25.318 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:54:25.318 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:54:25.318 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:25.318 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:25.318 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:25.319 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:54:25.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:54:25.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1781: test_wait_for_peered: create_rbd_pool 2026-02-17T12:54:25.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:54:25.429 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:54:25.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:54:25.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:54:25.614 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:54:25.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:54:26.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:54:26.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1782: test_wait_for_peered: WAIT_FOR_CLEAN_TIMEOUT=1 2026-02-17T12:54:26.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1782: test_wait_for_peered: wait_for_clean 2026-02-17T12:54:26.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:54:26.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:54:26.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:54:26.899 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 1 .1 2026-02-17T12:54:26.900 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:54:26.900 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:54:26.900 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:54:26.900 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:54:26.900 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:54:26.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.3') 2026-02-17T12:54:26.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:54:26.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:54:26.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:54:26.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:54:26.924 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:54:27.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:54:27.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:54:27.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:54:27.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:54:27.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=0 2026-02-17T12:54:27.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 0 2026-02-17T12:54:27.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-0' 2026-02-17T12:54:27.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:54:27.088 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-0 2026-02-17T12:54:27.088 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:54:27.089 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:54:27.089 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-0 2026-02-17T12:54:27.090 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:54:27.090 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=0 2026-02-17T12:54:27.091 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 0' 2026-02-17T12:54:27.091 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 0 2026-02-17T12:54:27.091 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:54:27.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 0 -lt 0 2026-02-17T12:54:27.195 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:54:27.195 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:54:27.195 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:54:27.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 == 0 2026-02-17T12:54:27.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: sleep 1 2026-02-17T12:54:28.299 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:54:28.300 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:54:28.300 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:54:28.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:54:28.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:54:28.558 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:54:28.558 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:54:28.558 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:54:28.558 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:54:28.558 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:54:28.559 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:54:28.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:54:28.743 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:54:28.744 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:54:28.744 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:54:29.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:54:29.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' -1 2026-02-17T12:54:29.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T12:54:29.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=0 2026-02-17T12:54:29.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:54:29.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T12:54:29.112 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:54:29.112 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:54:29.112 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:54:29.112 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:54:29.112 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:54:29.113 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:54:29.113 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:54:29.113 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:54:29.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:54:29.297 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:54:29.298 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:54:29.298 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:54:29.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:54:29.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:54:29.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:54:29.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:54:29.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:54:29.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:54:29.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:54:29.551 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:54:29.551 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:54:29.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:54:29.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:54:29.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 1 >= 4 )) 2026-02-17T12:54:29.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:54:29.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.2 2026-02-17T12:54:30.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:54:30.005 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:54:30.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:54:30.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:54:30.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:54:30.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:54:30.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:54:30.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:54:30.198 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:54:30.199 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:54:30.199 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:54:30.199 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:54:30.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:54:30.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:54:30.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:54:30.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:54:30.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:54:30.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:54:30.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:54:30.456 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:54:30.456 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:54:30.712 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:54:30.713 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:54:30.713 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 2 >= 4 )) 2026-02-17T12:54:30.713 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:54:30.713 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.4 2026-02-17T12:54:31.113 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:54:31.113 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:54:31.114 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:54:31.115 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:54:31.115 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:54:31.115 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:54:31.115 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:54:31.115 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:54:31.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:54:31.302 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:54:31.302 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:54:31.302 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:54:31.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:54:31.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:54:31.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:54:31.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:54:31.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:54:31.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:54:31.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:54:31.562 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:54:31.562 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:54:31.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:54:31.814 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:54:31.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 3 >= 4 )) 2026-02-17T12:54:31.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T12:54:31.815 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.3 2026-02-17T12:54:32.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T12:54:32.115 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:54:32.116 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:54:32.116 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:54:32.116 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:54:32.116 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:54:32.116 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:54:32.116 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:54:32.302 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T12:54:32.303 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:54:32.303 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:54:32.303 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:54:32.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 4 2026-02-17T12:54:32.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T12:54:32.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T12:54:32.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T12:54:32.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T12:54:32.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T12:54:32.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T12:54:32.570 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T12:54:32.570 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T12:54:32.826 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T12:54:32.826 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T12:54:32.826 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 4 >= 4 )) 2026-02-17T12:54:32.826 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1679: wait_for_clean: ceph report 2026-02-17T12:54:33.072 INFO:tasks.workunit.client.0.trial155.stdout:{ 2026-02-17T12:54:33.073 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_fingerprint": "a4215623-d081-48f0-b8df-183f20d51c38", 2026-02-17T12:54:33.073 INFO:tasks.workunit.client.0.trial155.stdout: "version": "19.2.3-675-g3c96dfb3", 2026-02-17T12:54:33.073 INFO:tasks.workunit.client.0.trial155.stdout: "commit": "3c96dfb3f50b3d02598a82af7104764bfdcd3919", 2026-02-17T12:54:33.073 INFO:tasks.workunit.client.0.trial155.stdout: "timestamp": "2026-02-17T12:54:33.071647+0000", 2026-02-17T12:54:33.073 INFO:tasks.workunit.client.0.trial155.stdout: "tag": "", 2026-02-17T12:54:33.073 INFO:tasks.workunit.client.0.trial155.stdout: "health": { 2026-02-17T12:54:33.073 INFO:tasks.workunit.client.0.trial155.stdout: "status": "HEALTH_WARN", 2026-02-17T12:54:33.073 INFO:tasks.workunit.client.0.trial155.stdout: "checks": { 2026-02-17T12:54:33.073 INFO:tasks.workunit.client.0.trial155.stdout: "PG_DEGRADED": { 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: "severity": "HEALTH_WARN", 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: "summary": { 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: "message": "Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded", 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: "count": 2 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: "detail": [ 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0]" 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0]" 2026-02-17T12:54:33.074 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: "muted": false 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: "TOO_FEW_OSDS": { 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: "severity": "HEALTH_WARN", 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: "summary": { 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: "message": "OSD count 1 < osd_pool_default_size 3", 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: "count": 2 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: "detail": [], 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: "muted": false 2026-02-17T12:54:33.075 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: "mutes": [] 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: "monmap_first_committed": 1, 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: "monmap_last_committed": 1, 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: "monmap": { 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 1, 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: "fsid": "af5bea88-7d02-4f39-9b2e-26dff0e1f9f6", 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: "modified": "2026-02-17T12:54:16.783712Z", 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: "created": "2026-02-17T12:54:16.783712Z", 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: "min_mon_release": 19, 2026-02-17T12:54:33.076 INFO:tasks.workunit.client.0.trial155.stdout: "min_mon_release_name": "squid", 2026-02-17T12:54:33.077 INFO:tasks.workunit.client.0.trial155.stdout: "election_strategy": 1, 2026-02-17T12:54:33.077 INFO:tasks.workunit.client.0.trial155.stdout: "disallowed_leaders": "", 2026-02-17T12:54:33.077 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode": false, 2026-02-17T12:54:33.077 INFO:tasks.workunit.client.0.trial155.stdout: "tiebreaker_mon": "", 2026-02-17T12:54:33.077 INFO:tasks.workunit.client.0.trial155.stdout: "removed_ranks": "", 2026-02-17T12:54:33.077 INFO:tasks.workunit.client.0.trial155.stdout: "features": { 2026-02-17T12:54:33.077 INFO:tasks.workunit.client.0.trial155.stdout: "persistent": [ 2026-02-17T12:54:33.077 INFO:tasks.workunit.client.0.trial155.stdout: "kraken", 2026-02-17T12:54:33.077 INFO:tasks.workunit.client.0.trial155.stdout: "luminous", 2026-02-17T12:54:33.077 INFO:tasks.workunit.client.0.trial155.stdout: "mimic", 2026-02-17T12:54:33.077 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap-prune", 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: "nautilus", 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: "octopus", 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: "pacific", 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: "elector-pinging", 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: "quincy", 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: "reef", 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: "squid" 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: "optional": [] 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: "mons": [ 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.078 INFO:tasks.workunit.client.0.trial155.stdout: "rank": 0, 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: "name": "a", 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: "public_addrs": { 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:7109", 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 0 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:7109/0", 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: "public_addr": "127.0.0.1:7109/0", 2026-02-17T12:54:33.079 INFO:tasks.workunit.client.0.trial155.stdout: "priority": 0, 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 0, 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: "crush_location": "{}" 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: "quorum": [ 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: 0 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap": { 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 11, 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: "fsid": "af5bea88-7d02-4f39-9b2e-26dff0e1f9f6", 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: "created": "2026-02-17T12:54:16.818018+0000", 2026-02-17T12:54:33.080 INFO:tasks.workunit.client.0.trial155.stdout: "modified": "2026-02-17T12:54:26.892922+0000", 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "last_up_change": "2026-02-17T12:54:24.686149+0000", 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "last_in_change": "2026-02-17T12:54:17.001910+0000", 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "flags_num": 5799936, 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "flags_set": [ 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "pglog_hardlimit", 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "purged_snapdirs", 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "recovery_deletes", 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "sortbitwise" 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "crush_version": 3, 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T12:54:33.081 INFO:tasks.workunit.client.0.trial155.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_snapshot": "", 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: "pool_max": 1, 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: "max_osd": 1, 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: "require_min_compat_client": "luminous", 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: "min_compat_client": "jewel", 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: "require_osd_release": "squid", 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: "allow_crimson": false, 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: "pools": [ 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: "pool": 1, 2026-02-17T12:54:33.082 INFO:tasks.workunit.client.0.trial155.stdout: "pool_name": "rbd", 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "create_time": "2026-02-17T12:54:25.514512+0000", 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "flags": 8193, 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "type": 1, 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "size": 2, 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "min_size": 1, 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "crush_rule": 0, 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_count": 0, 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_target": 0, 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "is_stretch_pool": false, 2026-02-17T12:54:33.083 INFO:tasks.workunit.client.0.trial155.stdout: "object_hash": 2, 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "pg_autoscale_mode": "off", 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "pg_num": 4, 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "pg_placement_num": 4, 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "pg_placement_num_target": 4, 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "pg_num_target": 4, 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "pg_num_pending": 4, 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "last_pg_merge_meta": { 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "source_pgid": "0.0", 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "ready_epoch": 0, 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "last_epoch_started": 0, 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "last_epoch_clean": 0, 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "source_version": "0'0", 2026-02-17T12:54:33.084 INFO:tasks.workunit.client.0.trial155.stdout: "target_version": "0'0" 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "last_change": "11", 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "last_force_op_resend": "0", 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "auid": 0, 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "snap_mode": "selfmanaged", 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "snap_seq": 2, 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "snap_epoch": 11, 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "pool_snaps": [], 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "removed_snaps": "[]", 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "quota_max_bytes": 0, 2026-02-17T12:54:33.085 INFO:tasks.workunit.client.0.trial155.stdout: "quota_max_objects": 0, 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "tiers": [], 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "tier_of": -1, 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "read_tier": -1, 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "write_tier": -1, 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "cache_mode": "none", 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "target_max_bytes": 0, 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "target_max_objects": 0, 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "cache_min_flush_age": 0, 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "cache_min_evict_age": 0, 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "erasure_code_profile": "", 2026-02-17T12:54:33.086 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_params": { 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "type": "none" 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_period": 0, 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_count": 0, 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "use_gmt_hitset": true, 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "min_read_recency_for_promote": 0, 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "min_write_recency_for_promote": 0, 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "hit_set_search_last_n": 0, 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "grade_table": [], 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "stripe_width": 0, 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "expected_num_objects": 0, 2026-02-17T12:54:33.087 INFO:tasks.workunit.client.0.trial155.stdout: "fast_read": false, 2026-02-17T12:54:33.088 INFO:tasks.workunit.client.0.trial155.stdout: "options": {}, 2026-02-17T12:54:33.088 INFO:tasks.workunit.client.0.trial155.stdout: "application_metadata": { 2026-02-17T12:54:33.088 INFO:tasks.workunit.client.0.trial155.stdout: "rbd": {} 2026-02-17T12:54:33.088 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.088 INFO:tasks.workunit.client.0.trial155.stdout: "read_balance": { 2026-02-17T12:54:33.088 INFO:tasks.workunit.client.0.trial155.stdout: "score_type": "Fair distribution", 2026-02-17T12:54:33.088 INFO:tasks.workunit.client.0.trial155.stdout: "score_acting": 1, 2026-02-17T12:54:33.088 INFO:tasks.workunit.client.0.trial155.stdout: "score_stable": 1, 2026-02-17T12:54:33.088 INFO:tasks.workunit.client.0.trial155.stdout: "optimal_score": 1, 2026-02-17T12:54:33.088 INFO:tasks.workunit.client.0.trial155.stdout: "raw_score_acting": 1, 2026-02-17T12:54:33.088 INFO:tasks.workunit.client.0.trial155.stdout: "raw_score_stable": 1, 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: "primary_affinity_weighted": 1, 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: "average_primary_affinity": 1, 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: "average_primary_affinity_weighted": 1 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: "osds": [ 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: "uuid": "2483ef95-2bd2-4053-a429-5985ba167d7d", 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: "up": 1, 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: "in": 1, 2026-02-17T12:54:33.089 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 1, 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "primary_affinity": 1, 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "last_clean_begin": 0, 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "last_clean_end": 0, 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "up_from": 5, 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "up_thru": 6, 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "down_at": 0, 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "lost_at": 0, 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "public_addrs": { 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6800", 2026-02-17T12:54:33.090 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2108857289 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6801", 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2108857289 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_addrs": { 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.091 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6802", 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2108857289 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6803", 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2108857289 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_back_addrs": { 2026-02-17T12:54:33.092 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6806", 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2108857289 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6807", 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2108857289 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_front_addrs": { 2026-02-17T12:54:33.093 INFO:tasks.workunit.client.0.trial155.stdout: "addrvec": [ 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v2", 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6804", 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2108857289 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: "type": "v1", 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: "addr": "127.0.0.1:6805", 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: "nonce": 2108857289 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.094 INFO:tasks.workunit.client.0.trial155.stdout: "public_addr": "127.0.0.1:6801/2108857289", 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: "cluster_addr": "127.0.0.1:6803/2108857289", 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2108857289", 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2108857289", 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: "state": [ 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: "exists", 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: "up" 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: "osd_xinfo": [ 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:54:33.095 INFO:tasks.workunit.client.0.trial155.stdout: "down_stamp": "0.000000", 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: "laggy_probability": 0, 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: "laggy_interval": 0, 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: "features": 4540701547738038271, 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: "old_weight": 0, 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: "dead_epoch": 0 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: "pg_upmap": [], 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: "pg_upmap_items": [], 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: "pg_upmap_primaries": [], 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: "pg_temp": [], 2026-02-17T12:54:33.096 INFO:tasks.workunit.client.0.trial155.stdout: "primary_temp": [], 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: "blocklist": {}, 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: "range_blocklist": {}, 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: "erasure_code_profiles": { 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: "default": { 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: "k": "2", 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: "m": "2", 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: "plugin": "jerasure", 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: "technique": "reed_sol_van" 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: "removed_snaps_queue": [ 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.097 INFO:tasks.workunit.client.0.trial155.stdout: "pool": 1, 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: "snaps": [ 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: "begin": 2, 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: "length": 1 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: "new_removed_snaps": [ 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: "pool": 1, 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: "snaps": [ 2026-02-17T12:54:33.098 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: "begin": 2, 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: "length": 1 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: "new_purged_snaps": [], 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: "crush_node_flags": {}, 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: "device_class_flags": {}, 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode": { 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode_enabled": false, 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_bucket_count": 0, 2026-02-17T12:54:33.099 INFO:tasks.workunit.client.0.trial155.stdout: "degraded_stretch_mode": 0, 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: "recovering_stretch_mode": 0, 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: "stretch_mode_bucket": 0 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: "osd_metadata": [ 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: "arch": "x86_64", 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: "back_addr": "[v2:127.0.0.1:6802/2108857289,v1:127.0.0.1:6803/2108857289]", 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: "back_iface": "", 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs": "1", 2026-02-17T12:54:33.100 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs_dedicated_db": "0", 2026-02-17T12:54:33.101 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T12:54:33.101 INFO:tasks.workunit.client.0.trial155.stdout: "bluefs_single_shared_device": "1", 2026-02-17T12:54:33.101 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T12:54:33.101 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_allocator": "hybrid", 2026-02-17T12:54:33.101 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T12:54:33.101 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T12:54:33.101 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T12:54:33.101 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T12:54:33.101 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T12:54:33.101 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_path": "td/ceph-helpers/0/block", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_release": "squid", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_version": "ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable)", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_version_short": "19.2.3-675-g3c96dfb3", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "ceph_version_when_created": "ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable)", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "created_at": "2026-02-17T12:54:18.896872Z", 2026-02-17T12:54:33.102 INFO:tasks.workunit.client.0.trial155.stdout: "default_device_class": "ssd", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD5F82", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "devices": "nvme0n1", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "distro": "centos", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "distro_version": "9", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "front_addr": "[v2:127.0.0.1:6800/2108857289,v1:127.0.0.1:6801/2108857289]", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "front_iface": "", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2108857289,v1:127.0.0.1:6807/2108857289]", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2108857289,v1:127.0.0.1:6805/2108857289]", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "hostname": "trial155", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "journal_rotational": "0", 2026-02-17T12:54:33.103 INFO:tasks.workunit.client.0.trial155.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: "mem_swap_kb": "8388604", 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: "mem_total_kb": "130438932", 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: "objectstore_numa_node": "0", 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: "objectstore_numa_nodes": "0", 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: "os": "Linux", 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: "osd_data": "td/ceph-helpers/0", 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: "osd_objectstore": "bluestore", 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: "osdspec_affinity": "", 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: "rotational": "0" 2026-02-17T12:54:33.104 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap_clean_epochs": { 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: "min_last_epoch_clean": 0, 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: "last_epoch_clean": { 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: "per_pool": [] 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: "osd_epochs": [ 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 5 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.105 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.106 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap_first_committed": 1, 2026-02-17T12:54:33.106 INFO:tasks.workunit.client.0.trial155.stdout: "osdmap_last_committed": 11, 2026-02-17T12:54:33.106 INFO:tasks.workunit.client.0.trial155.stdout: "crushmap": { 2026-02-17T12:54:33.106 INFO:tasks.workunit.client.0.trial155.stdout: "devices": [ 2026-02-17T12:54:33.106 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.106 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:54:33.106 INFO:tasks.workunit.client.0.trial155.stdout: "name": "osd.0", 2026-02-17T12:54:33.106 INFO:tasks.workunit.client.0.trial155.stdout: "class": "ssd" 2026-02-17T12:54:33.106 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.106 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.106 INFO:tasks.workunit.client.0.trial155.stdout: "types": [ 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 0, 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: "name": "osd" 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 1, 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: "name": "host" 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 2, 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: "name": "chassis" 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.107 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 3, 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: "name": "rack" 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 4, 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: "name": "row" 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 5, 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: "name": "pdu" 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.108 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 6, 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: "name": "pod" 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 7, 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: "name": "room" 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 8, 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: "name": "datacenter" 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 9, 2026-02-17T12:54:33.109 INFO:tasks.workunit.client.0.trial155.stdout: "name": "zone" 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 10, 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: "name": "region" 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 11, 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: "name": "root" 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: "buckets": [ 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: "id": -1, 2026-02-17T12:54:33.110 INFO:tasks.workunit.client.0.trial155.stdout: "name": "default", 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 11, 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "root", 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: "id": -3, 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.111 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: "id": -2, 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: "name": "default~ssd", 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 11, 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "root", 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: "id": -4, 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.112 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: "id": -3, 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: "name": "trial155", 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 1, 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "host", 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:54:33.113 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: "id": -4, 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: "name": "trial155~ssd", 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: "type_id": 1, 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: "type_name": "host", 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: "alg": "straw2", 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: "hash": "rjenkins1", 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: "items": [ 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: "id": 0, 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: "weight": 6402, 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: "pos": 0 2026-02-17T12:54:33.114 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: "rules": [ 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: "rule_id": 0, 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: "rule_name": "replicated_rule", 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: "type": 1, 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: "steps": [ 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: "op": "take", 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: "item": -1, 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: "item_name": "default" 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.115 INFO:tasks.workunit.client.0.trial155.stdout: "op": "choose_firstn", 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: "num": 0, 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: "type": "osd" 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: "op": "emit" 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: ] 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: "tunables": { 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: "choose_local_tries": 0, 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: "choose_local_fallback_tries": 0, 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: "choose_total_tries": 50, 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: "chooseleaf_descend_once": 1, 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: "chooseleaf_vary_r": 1, 2026-02-17T12:54:33.116 INFO:tasks.workunit.client.0.trial155.stdout: "chooseleaf_stable": 1, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "msr_descents": 100, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "msr_collision_tries": 100, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "straw_calc_version": 1, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "allowed_bucket_algs": 54, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "profile": "jewel", 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "optimal_tunables": 1, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "legacy_tunables": 0, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "minimum_required_version": "jewel", 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables": 1, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables2": 1, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "has_v2_rules": 0, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables3": 1, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "has_v3_rules": 0, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "has_v4_buckets": 1, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "require_feature_tunables5": 1, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "has_v5_rules": 0, 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: "has_msr_rules": 0 2026-02-17T12:54:33.117 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "choose_args": {} 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "fsmap": { 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 1, 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "btime": "2026-02-17T12:54:16:817865+0000", 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "default_fscid": -1, 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "compat": { 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "compat": {}, 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "ro_compat": {}, 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "incompat": { 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "feature_1": "base v0.20", 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "feature_2": "client writeable ranges", 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "feature_4": "dir inode in separate object", 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T12:54:33.118 INFO:tasks.workunit.client.0.trial155.stdout: "feature_8": "no anchor table", 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "feature_9": "file layout v2", 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "feature_10": "snaprealm v2", 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "feature_11": "minor log segments", 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "feature_flags": { 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "enable_multiple": true, 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "ever_enabled_multiple": true 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "standbys": [], 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "filesystems": [] 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "mdsmap_first_committed": 1, 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "mdsmap_last_committed": 1, 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "auth": { 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "first_committed": 1, 2026-02-17T12:54:33.119 INFO:tasks.workunit.client.0.trial155.stdout: "last_committed": 3, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_secrets": 1 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg": 4, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_active": 4, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_unknown": 0, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_osd": 1, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "pool_sum": { 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "stat_sum": { 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes": 19, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects": 2, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_clones": 0, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_copies": 4, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing": 0, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_degraded": 2, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_misplaced": 0, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_unfound": 0, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_dirty": 2, 2026-02-17T12:54:33.120 INFO:tasks.workunit.client.0.trial155.stdout: "num_whiteouts": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_read": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_read_kb": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_write": 2, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_write_kb": 2, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_scrub_errors": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_deep_scrub_errors": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_recovered": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_recovered": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_keys_recovered": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_omap": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_kb": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_kb": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_promote": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_high": 0, 2026-02-17T12:54:33.121 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_low": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_some": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_full": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_pinned": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "num_legacy_snapsets": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "num_large_omap_objects": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_manifest": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_bytes": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_keys": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_repaired": 0 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "store_stats": { 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "total": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "available": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:54:33.122 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 0, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 0 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "log_size": 3, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "ondisk_log_size": 3, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "up": 4, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "acting": 4, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "num_store_stats": 0 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "osd_sum": { 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "up_from": 0, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "seq": 0, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "num_pgs": 4, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "num_osds": 1, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_osds": 1, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_omap_osds": 1, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "kb": 104857600, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used": 27088, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_data": 100, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_omap": 1, 2026-02-17T12:54:33.123 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_meta": 26942, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "kb_avail": 104830512, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "statfs": { 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "total": 107374182400, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "available": 107346444288, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 102400, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 21364, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 1594, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 27589062 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "hb_peers": [], 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "snap_trim_queue_len": 0, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "num_snap_trimming": 0, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "num_shards_repaired": 0, 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "op_queue_age_hist": { 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "histogram": [], 2026-02-17T12:54:33.124 INFO:tasks.workunit.client.0.trial155.stdout: "upper_bound": 1 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "perf_stat": { 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ms": 1, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ms": 1, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ns": 1000000, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ns": 1000000 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "alerts": [], 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "network_ping_times": [] 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "osd_sum_by_class": { 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "ssd": { 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "up_from": 0, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "seq": 0, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "num_pgs": 4, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "num_osds": 1, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_osds": 1, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "num_per_pool_omap_osds": 1, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "kb": 104857600, 2026-02-17T12:54:33.125 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used": 27088, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_data": 100, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_omap": 1, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "kb_used_meta": 26942, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "kb_avail": 104830512, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "statfs": { 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "total": 107374182400, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "available": 107346444288, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 102400, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 21364, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 1594, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 27589062 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "hb_peers": [], 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "snap_trim_queue_len": 0, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "num_snap_trimming": 0, 2026-02-17T12:54:33.126 INFO:tasks.workunit.client.0.trial155.stdout: "num_shards_repaired": 0, 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "op_queue_age_hist": { 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "histogram": [], 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "upper_bound": 1 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "perf_stat": { 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ms": 1, 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ms": 1, 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "commit_latency_ns": 1000000, 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "apply_latency_ns": 1000000 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "alerts": [], 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "network_ping_times": [] 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "pool_stats": [ 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "poolid": 1, 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg": 4, 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "stat_sum": { 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes": 19, 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects": 2, 2026-02-17T12:54:33.127 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_clones": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_object_copies": 4, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_missing": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_degraded": 2, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_misplaced": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_unfound": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_dirty": 2, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_whiteouts": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_read": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_read_kb": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_write": 2, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_write_kb": 2, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_scrub_errors": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_deep_scrub_errors": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_recovered": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_recovered": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_keys_recovered": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_omap": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush": 0, 2026-02-17T12:54:33.128 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_kb": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_kb": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_promote": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_high": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_flush_mode_low": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_some": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_evict_mode_full": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_pinned": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_legacy_snapsets": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_large_omap_objects": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_manifest": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_bytes": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_omap_keys": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "num_objects_repaired": 0 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "store_stats": { 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "total": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "available": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "internally_reserved": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "allocated": 4096, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "data_stored": 19, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed": 0, 2026-02-17T12:54:33.129 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_allocated": 0, 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "data_compressed_original": 0, 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "omap_allocated": 0, 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "internal_metadata": 0 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "log_size": 3, 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "ondisk_log_size": 3, 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "up": 4, 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "acting": 4, 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "num_store_stats": 1 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "osd_stats": [ 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "seq": 21474836481 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_by_state": [ 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "state": "active+undersized+degraded", 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "num": 2 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.130 INFO:tasks.workunit.client.0.trial155.stdout: "state": "active+undersized", 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "num": 2 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "num_pg_by_osd": [ 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "osd": 0, 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "num_primary_pg": 4, 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "num_acting_pg": 4, 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "num_up_not_acting_pg": 0 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "purged_snaps": [ 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: { 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "pool": 1, 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "purged_snaps": {} 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: ], 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "servicemap": { 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "epoch": 1, 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "modified": "2026-02-17T12:54:16.818130+0000", 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "services": {} 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: }, 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "mgrstat_first_committed": 1, 2026-02-17T12:54:33.131 INFO:tasks.workunit.client.0.trial155.stdout: "mgrstat_last_committed": 4, 2026-02-17T12:54:33.132 INFO:tasks.workunit.client.0.trial155.stdout: "logm_first_committed": 1, 2026-02-17T12:54:33.132 INFO:tasks.workunit.client.0.trial155.stdout: "logm_last_committed": 57, 2026-02-17T12:54:33.132 INFO:tasks.workunit.client.0.trial155.stdout: "paxos": { 2026-02-17T12:54:33.132 INFO:tasks.workunit.client.0.trial155.stdout: "first_committed": 1, 2026-02-17T12:54:33.132 INFO:tasks.workunit.client.0.trial155.stdout: "last_committed": 81, 2026-02-17T12:54:33.132 INFO:tasks.workunit.client.0.trial155.stdout: "last_pn": 0, 2026-02-17T12:54:33.132 INFO:tasks.workunit.client.0.trial155.stdout: "accepted_pn": 0 2026-02-17T12:54:33.132 INFO:tasks.workunit.client.0.trial155.stdout: } 2026-02-17T12:54:33.132 INFO:tasks.workunit.client.0.trial155.stdout:} 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:report 2959982591 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1680: wait_for_clean: return 1 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1783: test_wait_for_peered: run_osd td/ceph-helpers 1 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/1 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:54:33.134 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/1 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2b681eec-6714-4316-b3a3-a1146ba58961 2026-02-17T12:54:33.135 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 2b681eec-6714-4316-b3a3-a1146ba58961 2026-02-17T12:54:33.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 2b681eec-6714-4316-b3a3-a1146ba58961' 2026-02-17T12:54:33.136 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:54:33.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAJZZRpyMWfBRAAZAMevQ1pyK14KhqZLWn3iw== 2026-02-17T12:54:33.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAJZZRpyMWfBRAAZAMevQ1pyK14KhqZLWn3iw=="}' 2026-02-17T12:54:33.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2b681eec-6714-4316-b3a3-a1146ba58961 -i td/ceph-helpers/1/new.json 2026-02-17T12:54:33.290 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:54:33.297 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/1/new.json 2026-02-17T12:54:33.298 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAJZZRpyMWfBRAAZAMevQ1pyK14KhqZLWn3iw== --osd-uuid 2b681eec-6714-4316-b3a3-a1146ba58961 2026-02-17T12:54:33.316 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:33.315+0000 7f2973ad7780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:33.317 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:33.316+0000 7f2973ad7780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:33.318 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:33.317+0000 7f2973ad7780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:33.319 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:33.317+0000 7f2973ad7780 -1 bdev(0x555661209c00 td/ceph-helpers/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:54:33.319 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:33.318+0000 7f2973ad7780 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2026-02-17T12:54:35.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/1/keyring 2026-02-17T12:54:35.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:54:35.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:54:35.449 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:54:35.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:54:35.708 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:54:35.708 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:54:35.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:54:35.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:54:35.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:54:35.709 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:54:35.725 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:35.723+0000 7f8d2aa1a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:35.726 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:35.725+0000 7f8d2aa1a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:35.727 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:35.726+0000 7f8d2aa1a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:35.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:54:35.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:54:35.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:54:35.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:54:35.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:54:35.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:35.899 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:54:35.900 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:54:35.900 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:35.900 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:36.090 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:37.091 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:37.091 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:37.091 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:54:37.092 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:54:37.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:37.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:37.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:37.321 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:37.319+0000 7f8d2aa1a780 -1 Falling back to public interface 2026-02-17T12:54:38.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:38.282 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:38.282 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:54:38.282 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:54:38.283 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:38.283 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:38.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:39.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:39.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:39.475 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:54:39.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:54:39.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:39.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:39.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:40.274 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:40.272+0000 7f8d2aa1a780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:54:40.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:40.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:40.667 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:54:40.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:54:40.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:40.667 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:40.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:41.862 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:41.862 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:41.863 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:54:41.863 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:54:41.863 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:41.864 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:54:42.053 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 15 up_thru 15 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/974529807,v1:127.0.0.1:6811/974529807] [v2:127.0.0.1:6812/974529807,v1:127.0.0.1:6813/974529807] exists,up 2b681eec-6714-4316-b3a3-a1146ba58961 2026-02-17T12:54:42.054 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:54:42.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:54:42.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:54:42.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1784: test_wait_for_peered: wait_for_peered 2026-02-17T12:54:42.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1740: wait_for_peered: local cmd= 2026-02-17T12:54:42.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1741: wait_for_peered: local num_peered=-1 2026-02-17T12:54:42.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1742: wait_for_peered: local cur_peered 2026-02-17T12:54:42.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_peered: get_timeout_delays 90 .1 2026-02-17T12:54:42.055 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:54:42.055 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:54:42.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:54:42.055 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:54:42.056 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:54:42.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_peered: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:54:42.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_peered: local -a delays 2026-02-17T12:54:42.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_peered: local -i loop=0 2026-02-17T12:54:42.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_peered: flush_pg_stats 2026-02-17T12:54:42.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:54:42.137 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:54:42.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:54:42.327 INFO:tasks.workunit.client.0.trial155.stderr:1' 2026-02-17T12:54:42.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:54:42.327 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:54:42.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:54:42.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836485 2026-02-17T12:54:42.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836485 2026-02-17T12:54:42.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T12:54:42.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:54:42.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:54:42.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=64424509444 2026-02-17T12:54:42.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 64424509444 2026-02-17T12:54:42.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836485 1-64424509444' 2026-02-17T12:54:42.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:54:42.454 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836485 2026-02-17T12:54:42.454 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:54:42.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:54:42.455 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836485 2026-02-17T12:54:42.455 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:54:42.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836485 2026-02-17T12:54:42.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T12:54:42.457 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836485 2026-02-17T12:54:42.457 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:54:42.646 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-17T12:54:42.646 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:54:43.646 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:54:43.647 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:54:43.837 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836486 -lt 21474836485 2026-02-17T12:54:43.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:54:43.838 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-64424509444 2026-02-17T12:54:43.838 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:54:43.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:54:43.839 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-64424509444 2026-02-17T12:54:43.840 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:54:43.840 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=64424509444 2026-02-17T12:54:43.840 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 64424509444' 2026-02-17T12:54:43.841 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 64424509444 2026-02-17T12:54:43.841 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:54:44.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 64424509444 -lt 64424509444 2026-02-17T12:54:44.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1747: wait_for_peered: get_num_pgs 2026-02-17T12:54:44.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:54:44.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:54:44.286 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1747: wait_for_peered: test 4 == 0 2026-02-17T12:54:44.286 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1751: wait_for_peered: true 2026-02-17T12:54:44.286 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1755: wait_for_peered: get_num_active_or_peered 2026-02-17T12:54:44.286 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1394: get_num_active_or_peered: local expression 2026-02-17T12:54:44.286 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1395: get_num_active_or_peered: expression+='select(contains("active") or contains("peered")) | ' 2026-02-17T12:54:44.286 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1396: get_num_active_or_peered: expression+='select(contains("stale") | not)' 2026-02-17T12:54:44.286 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1397: get_num_active_or_peered: ceph --format json pg dump pgs 2026-02-17T12:54:44.286 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1398: get_num_active_or_peered: jq '.pg_stats | [.[] | .state | select(contains("active") or contains("peered")) | select(contains("stale") | not)] | length' 2026-02-17T12:54:44.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1755: wait_for_peered: cur_peered=4 2026-02-17T12:54:44.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1756: wait_for_peered: get_num_pgs 2026-02-17T12:54:44.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:54:44.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:54:44.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1756: wait_for_peered: test 4 = 4 2026-02-17T12:54:44.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1756: wait_for_peered: break 2026-02-17T12:54:44.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1771: wait_for_peered: return 0 2026-02-17T12:54:44.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: test_wait_for_peered: teardown td/ceph-helpers 2026-02-17T12:54:44.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:54:44.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:54:44.737 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:54:44.737 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:54:44.737 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:54:44.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:54:44.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:54:44.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:54:44.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:54:44.844 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:54:44.845 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:54:44.845 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:54:44.846 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:54:44.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:54:44.847 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:54:44.848 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:54:44.848 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:54:44.848 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:54:44.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:54:44.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:54:44.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:54:44.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:54:44.856 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:54:44.856 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:44.856 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:44.856 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:54:44.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:54:44.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:54:44.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:54:44.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_wait_for_scrub td/ceph-helpers 2026-02-17T12:54:44.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: test_wait_for_scrub: local dir=td/ceph-helpers 2026-02-17T12:54:44.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2088: test_wait_for_scrub: setup td/ceph-helpers 2026-02-17T12:54:44.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:54:44.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:54:44.859 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:54:44.859 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:54:44.859 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:54:44.859 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:54:44.859 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:54:44.859 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:54:44.859 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:54:44.859 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:54:44.860 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:54:44.860 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:54:44.860 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:54:44.860 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:54:44.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:54:44.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:54:44.861 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:54:44.862 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:54:44.862 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:54:44.862 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:54:44.863 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:54:44.863 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:54:44.864 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:54:44.864 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:54:44.865 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:54:44.865 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:44.865 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:44.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:54:44.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:54:44.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:54:44.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:54:44.868 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:54:44.868 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:44.868 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:44.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:54:44.869 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:54:44.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:54:44.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:54:44.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:54:44.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2089: test_wait_for_scrub: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:54:44.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:54:44.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:54:44.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:54:44.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:54:44.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:54:44.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:54:44.890 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:54:44.890 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:54:44.890 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:54:44.890 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:54:44.890 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:44.891 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:44.891 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:44.891 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:54:44.917 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:54:44.918 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:54:44.919 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:54:44.919 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:54:44.919 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:54:44.919 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:54:44.919 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:54:44.919 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:54:44.919 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:54:44.920 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:54:44.920 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:44.920 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:44.920 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:54:44.920 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:54:44.921 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:54:44.967 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:54:44.968 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:54:44.968 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:54:44.968 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:54:44.968 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:54:44.968 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:54:44.968 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:54:44.968 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:54:44.969 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:54:44.969 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:44.969 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:44.969 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:54:44.969 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:54:44.970 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:54:45.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2090: test_wait_for_scrub: run_mgr td/ceph-helpers x 2026-02-17T12:54:45.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:54:45.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:54:45.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:54:45.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:54:45.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:54:45.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:54:45.114 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:54:45.115 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:54:45.115 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:54:45.115 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:54:45.115 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:45.115 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:45.115 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:45.116 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:54:45.116 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:54:45.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2091: test_wait_for_scrub: run_osd td/ceph-helpers 0 2026-02-17T12:54:45.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:54:45.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:54:45.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:54:45.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:54:45.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:54:45.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:54:45.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:54:45.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:54:45.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:54:45.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:54:45.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:54:45.138 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:54:45.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=edb5a1f2-c8e7-4f65-a5f4-c5a3925ae921 2026-02-17T12:54:45.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 edb5a1f2-c8e7-4f65-a5f4-c5a3925ae921' 2026-02-17T12:54:45.139 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 edb5a1f2-c8e7-4f65-a5f4-c5a3925ae921 2026-02-17T12:54:45.139 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:54:45.148 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAVZZRpMTbICBAA5LuvFQZYYmEDj2SEnRVVEQ== 2026-02-17T12:54:45.148 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAVZZRpMTbICBAA5LuvFQZYYmEDj2SEnRVVEQ=="}' 2026-02-17T12:54:45.149 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new edb5a1f2-c8e7-4f65-a5f4-c5a3925ae921 -i td/ceph-helpers/0/new.json 2026-02-17T12:54:45.251 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:54:45.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:54:45.258 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAVZZRpMTbICBAA5LuvFQZYYmEDj2SEnRVVEQ== --osd-uuid edb5a1f2-c8e7-4f65-a5f4-c5a3925ae921 2026-02-17T12:54:45.276 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:45.275+0000 7fd98172a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:45.278 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:45.276+0000 7fd98172a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:45.279 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:45.277+0000 7fd98172a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:45.279 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:45.278+0000 7fd98172a780 -1 bdev(0x55b71be59c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:54:45.279 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:45.278+0000 7fd98172a780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:54:48.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:54:48.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:54:48.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:54:48.161 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:54:48.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:54:48.420 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:54:48.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:54:48.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:54:48.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:54:48.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:54:48.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:54:48.437 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:48.436+0000 7ff4d93ad780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:48.438 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:48.437+0000 7ff4d93ad780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:48.439 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:48.438+0000 7ff4d93ad780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:54:48.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:54:48.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:54:48.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:54:48.608 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:54:48.609 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:54:48.609 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:48.609 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:54:48.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:54:48.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:48.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:48.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:49.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:49.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:49.802 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:54:49.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:54:49.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:49.802 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:49.993 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:50.031 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:50.029+0000 7ff4d93ad780 -1 Falling back to public interface 2026-02-17T12:54:50.994 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:50.994 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:50.995 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:54:50.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:54:50.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:50.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:51.183 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:52.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:52.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:52.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:54:52.185 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:54:52.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:52.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:52.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:52.980 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:54:52.978+0000 7ff4d93ad780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:54:53.377 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:53.378 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:53.378 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:54:53.378 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:54:53.379 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:53.379 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:53.567 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:54:54.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:54:54.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:54:54.569 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:54:54.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:54:54.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:54:54.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:54:54.759 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1489917118,v1:127.0.0.1:6803/1489917118] [v2:127.0.0.1:6804/1489917118,v1:127.0.0.1:6805/1489917118] exists,up edb5a1f2-c8e7-4f65-a5f4-c5a3925ae921 2026-02-17T12:54:54.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:54:54.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:54:54.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:54:54.760 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2092: test_wait_for_scrub: create_rbd_pool 2026-02-17T12:54:54.761 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:54:54.942 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:54:54.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:54:54.949 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:54:55.188 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:54:55.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:54:56.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:54:56.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2093: test_wait_for_scrub: wait_for_clean 2026-02-17T12:54:56.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:54:56.479 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:54:56.479 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:54:56.479 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:54:56.480 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:54:56.480 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:54:56.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:54:56.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:54:56.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:54:56.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:54:56.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:54:56.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:54:56.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:54:56.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:54:56.564 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:54:56.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:54:56.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:54:56.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:54:56.754 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:54:56.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836483 2026-02-17T12:54:56.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836483 2026-02-17T12:54:56.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T12:54:56.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:54:56.819 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836483 2026-02-17T12:54:56.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:54:56.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:54:56.821 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836483 2026-02-17T12:54:56.821 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:54:56.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836483 2026-02-17T12:54:56.822 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T12:54:56.822 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836483 2026-02-17T12:54:56.822 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:54:57.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T12:54:57.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:54:58.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:54:58.016 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:54:58.206 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T12:54:58.207 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:54:58.207 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:54:58.207 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:54:58.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:54:58.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:54:58.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:54:58.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:54:58.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:54:58.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:54:58.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:54:58.473 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:54:58.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:54:58.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:54:58.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:54:58.658 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:54:58.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:54:58.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:54:58.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:54:58.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2094: test_wait_for_scrub: local pgid=1.0 2026-02-17T12:54:58.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2095: test_wait_for_scrub: ceph pg repair 1.0 2026-02-17T12:54:59.095 INFO:tasks.workunit.client.0.trial155.stderr:instructing pg 1.0 on osd.0 to repair 2026-02-17T12:54:59.102 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2096: test_wait_for_scrub: get_last_scrub_stamp 1.0 2026-02-17T12:54:59.103 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:54:59.103 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:54:59.103 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:54:59.103 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:54:59.289 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2096: test_wait_for_scrub: local last_scrub=2026-02-17T12:54:55.138117+0000 2026-02-17T12:54:59.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2097: test_wait_for_scrub: wait_for_scrub 1.0 2026-02-17T12:54:55.138117+0000 2026-02-17T12:54:59.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: wait_for_scrub: local pgid=1.0 2026-02-17T12:54:59.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: wait_for_scrub: local last_scrub=2026-02-17T12:54:55.138117+0000 2026-02-17T12:54:59.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T12:54:59.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i=0 )) 2026-02-17T12:54:59.290 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:54:59.290 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:54:59.290 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:54:59.290 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:54:59.290 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:54:59.290 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:54:59.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:54:55.138117+0000 '>' 2026-02-17T12:54:55.138117+0000 2026-02-17T12:54:59.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:55:00.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:55:00.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:55:00.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:55:00.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:55:00.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:55:00.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:55:00.478 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:55:00.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:54:55.138117+0000 '>' 2026-02-17T12:54:55.138117+0000 2026-02-17T12:55:00.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:55:01.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:55:01.671 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:55:01.671 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:55:01.672 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:55:01.672 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:55:01.672 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:55:01.672 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:55:01.860 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:54:55.138117+0000 '>' 2026-02-17T12:54:55.138117+0000 2026-02-17T12:55:01.860 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:55:02.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:55:02.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:55:02.862 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:55:02.862 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:55:02.862 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:55:02.862 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:55:02.862 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:55:03.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:54:55.138117+0000 '>' 2026-02-17T12:54:55.138117+0000 2026-02-17T12:55:03.051 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:55:04.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:55:04.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:55:04.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:55:04.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:55:04.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:55:04.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:55:04.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:55:04.239 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:54:55.138117+0000 '>' 2026-02-17T12:54:55.138117+0000 2026-02-17T12:55:04.239 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:55:05.240 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:55:05.240 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 300 )) 2026-02-17T12:55:05.241 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:55:05.241 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:55:05.241 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:55:05.242 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:55:05.242 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:55:05.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:54:59.997490+0000 '>' 2026-02-17T12:54:55.138117+0000 2026-02-17T12:55:05.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: wait_for_scrub: return 0 2026-02-17T12:55:05.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2098: test_wait_for_scrub: kill_daemons td/ceph-helpers KILL osd 2026-02-17T12:55:05.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:55:05.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:55:05.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:55:05.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:55:05.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:55:05.537 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:55:05.538 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2099: test_wait_for_scrub: get_last_scrub_stamp 1.0 2026-02-17T12:55:05.538 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:55:05.538 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:55:05.538 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:55:05.539 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:55:05.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2099: test_wait_for_scrub: last_scrub=2026-02-17T12:54:59.997490+0000 2026-02-17T12:55:05.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2100: test_wait_for_scrub: TIMEOUT=1 2026-02-17T12:55:05.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2100: test_wait_for_scrub: wait_for_scrub 1.0 2026-02-17T12:54:59.997490+0000 2026-02-17T12:55:05.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: wait_for_scrub: local pgid=1.0 2026-02-17T12:55:05.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: wait_for_scrub: local last_scrub=2026-02-17T12:54:59.997490+0000 2026-02-17T12:55:05.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T12:55:05.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i=0 )) 2026-02-17T12:55:05.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 1 )) 2026-02-17T12:55:05.726 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T12:55:05.726 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_last_scrub_stamp: local pgid=1.0 2026-02-17T12:55:05.726 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T12:55:05.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1528: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T12:55:05.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1529: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T12:55:05.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: wait_for_scrub: test 2026-02-17T12:54:59.997490+0000 '>' 2026-02-17T12:54:59.997490+0000 2026-02-17T12:55:05.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: wait_for_scrub: sleep 1 2026-02-17T12:55:06.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i++ )) 2026-02-17T12:55:06.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: wait_for_scrub: (( i < 1 )) 2026-02-17T12:55:06.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: wait_for_scrub: return 1 2026-02-17T12:55:06.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2101: test_wait_for_scrub: teardown td/ceph-helpers 2026-02-17T12:55:06.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:55:06.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:55:06.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:55:06.912 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:55:06.912 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:55:06.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:55:06.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:55:06.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:55:07.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:55:07.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:55:07.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:55:07.021 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:55:07.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:55:07.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:55:07.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:55:07.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:55:07.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:55:07.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:55:07.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:55:07.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:55:07.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:55:07.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:55:07.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:55:07.030 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:07.031 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:55:07.031 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:55:07.032 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:55:07.032 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:55:07.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: run_tests: for func in $funcs 2026-02-17T12:55:07.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: run_tests: test_wait_osd_id_used_by_pgs td/ceph-helpers 2026-02-17T12:55:07.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1501: test_wait_osd_id_used_by_pgs: local dir=td/ceph-helpers 2026-02-17T12:55:07.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1503: test_wait_osd_id_used_by_pgs: setup td/ceph-helpers 2026-02-17T12:55:07.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2026-02-17T12:55:07.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2026-02-17T12:55:07.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:55:07.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:55:07.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:55:07.033 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:55:07.033 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:55:07.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:55:07.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:55:07.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:55:07.034 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:55:07.034 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:55:07.035 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:55:07.035 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:55:07.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:55:07.036 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:55:07.036 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:55:07.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:55:07.037 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:55:07.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:55:07.038 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:55:07.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:55:07.039 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:55:07.039 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:55:07.041 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:55:07.041 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:07.041 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:55:07.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:55:07.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:55:07.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:55:07.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2026-02-17T12:55:07.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:55:07.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:07.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:55:07.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.83920 2026-02-17T12:55:07.044 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:55:07.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:55:07.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:55:07.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2026-02-17T12:55:07.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1504: test_wait_osd_id_used_by_pgs: run_mon td/ceph-helpers a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:55:07.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2026-02-17T12:55:07.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:55:07.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:55:07.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:55:07.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2026-02-17T12:55:07.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:55:07.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:55:07.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:55:07.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:55:07.065 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:55:07.065 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:07.065 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:55:07.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:55:07.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T12:55:07.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:55:07.092 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:55:07.093 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:55:07.093 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:55:07.093 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:55:07.093 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:55:07.094 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:55:07.094 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:55:07.094 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:55:07.094 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:55:07.094 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:07.095 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:55:07.095 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:55:07.095 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:55:07.095 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get fsid 2026-02-17T12:55:07.138 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:55:07.138 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:55:07.139 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:55:07.139 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:55:07.139 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:55:07.140 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:55:07.140 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:55:07.140 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:55:07.140 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:55:07.140 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:07.140 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:55:07.140 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.83920/ceph-mon.a.asok 2026-02-17T12:55:07.141 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:55:07.141 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.83920/ceph-mon.a.asok config get mon_host 2026-02-17T12:55:07.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1505: test_wait_osd_id_used_by_pgs: run_mgr td/ceph-helpers x 2026-02-17T12:55:07.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ceph-helpers 2026-02-17T12:55:07.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:55:07.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:55:07.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:55:07.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ceph-helpers/x 2026-02-17T12:55:07.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:55:07.284 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:55:07.284 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:55:07.285 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:55:07.285 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:55:07.285 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:07.285 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:55:07.285 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:55:07.285 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:55:07.286 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:55:07.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1506: test_wait_osd_id_used_by_pgs: run_osd td/ceph-helpers 0 2026-02-17T12:55:07.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ceph-helpers 2026-02-17T12:55:07.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:55:07.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:55:07.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:55:07.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ceph-helpers/0 2026-02-17T12:55:07.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 ' 2026-02-17T12:55:07.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:55:07.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:55:07.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:55:07.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:55:07.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ceph-helpers/0 2026-02-17T12:55:07.308 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:55:07.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=43f0da88-bdfb-4459-a9a8-c2a73fbc7060 2026-02-17T12:55:07.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 43f0da88-bdfb-4459-a9a8-c2a73fbc7060' 2026-02-17T12:55:07.309 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 43f0da88-bdfb-4459-a9a8-c2a73fbc7060 2026-02-17T12:55:07.309 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:55:07.317 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQArZZRpIqTcEhAAgQ+2TT79spoPWqH21NZcGA== 2026-02-17T12:55:07.318 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQArZZRpIqTcEhAAgQ+2TT79spoPWqH21NZcGA=="}' 2026-02-17T12:55:07.318 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 43f0da88-bdfb-4459-a9a8-c2a73fbc7060 -i td/ceph-helpers/0/new.json 2026-02-17T12:55:07.420 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:55:07.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ceph-helpers/0/new.json 2026-02-17T12:55:07.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQArZZRpIqTcEhAAgQ+2TT79spoPWqH21NZcGA== --osd-uuid 43f0da88-bdfb-4459-a9a8-c2a73fbc7060 2026-02-17T12:55:07.445 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:07.444+0000 7f71f3c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:07.447 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:07.445+0000 7f71f3c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:07.448 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:07.446+0000 7f71f3c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:07.448 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:07.447+0000 7f71f3c13780 -1 bdev(0x557445925c00 td/ceph-helpers/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:55:07.448 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:07.447+0000 7f71f3c13780 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2026-02-17T12:55:10.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ceph-helpers/0/keyring 2026-02-17T12:55:10.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:55:10.336 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:55:10.337 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:55:10.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:55:10.596 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:55:10.597 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:55:10.597 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --cluster ceph --fsid=af5bea88-7d02-4f39-9b2e-26dff0e1f9f6 --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.83920/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:55:10.597 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:55:10.597 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:55:10.597 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:55:10.613 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:10.611+0000 7f7e00416780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:10.615 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:10.613+0000 7f7e00416780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:10.616 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:10.614+0000 7f7e00416780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:10.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:55:10.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:55:10.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:55:10.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:55:10.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:55:10.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:10.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:55:10.787 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:55:10.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:10.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:55:10.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:11.960 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:11.958+0000 7f7e00416780 -1 Falling back to public interface 2026-02-17T12:55:11.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:11.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:11.976 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:55:11.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:55:11.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:11.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:55:12.174 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:13.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:13.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:13.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:55:13.176 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:55:13.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:13.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:55:13.366 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:14.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:14.367 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:14.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:55:14.368 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:55:14.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:14.368 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:55:14.556 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:14.674 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:14.671+0000 7f7e00416780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:55:15.557 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:15.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:15.558 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:55:15.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:55:15.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:15.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:55:15.750 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3296560808,v1:127.0.0.1:6803/3296560808] [v2:127.0.0.1:6804/3296560808,v1:127.0.0.1:6805/3296560808] exists,up 43f0da88-bdfb-4459-a9a8-c2a73fbc7060 2026-02-17T12:55:15.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:55:15.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:55:15.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:55:15.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1507: test_wait_osd_id_used_by_pgs: create_rbd_pool 2026-02-17T12:55:15.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T12:55:15.943 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' does not exist 2026-02-17T12:55:15.950 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T12:55:15.950 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T12:55:16.189 INFO:tasks.workunit.client.0.trial155.stderr:pool 'rbd' already exists 2026-02-17T12:55:16.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:55:17.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T12:55:17.479 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1508: test_wait_osd_id_used_by_pgs: wait_for_clean 2026-02-17T12:55:17.479 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:55:17.479 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:55:17.479 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:55:17.479 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:55:17.480 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:55:17.480 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:55:17.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:55:17.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:55:17.480 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:55:17.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:55:17.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:55:17.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:55:17.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:55:17.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:55:17.563 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:55:17.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids=0 2026-02-17T12:55:17.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:55:17.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:55:17.753 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:55:17.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836484 2026-02-17T12:55:17.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836484 2026-02-17T12:55:17.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836484' 2026-02-17T12:55:17.816 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:55:17.816 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836484 2026-02-17T12:55:17.817 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:55:17.817 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:55:17.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836484 2026-02-17T12:55:17.818 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:55:17.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836484 2026-02-17T12:55:17.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-17T12:55:17.819 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836484 2026-02-17T12:55:17.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:55:18.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T12:55:18.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:55:19.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:55:19.010 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:55:19.200 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T12:55:19.200 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:55:20.201 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:55:20.202 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:55:20.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-17T12:55:20.391 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:55:20.392 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:55:20.392 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:55:20.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T12:55:20.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:55:20.647 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:55:20.647 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:55:20.647 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:55:20.647 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:55:20.647 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:55:20.648 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:55:20.833 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T12:55:20.834 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:55:20.834 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:55:20.834 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:55:21.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T12:55:21.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:55:21.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:55:21.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1509: test_wait_osd_id_used_by_pgs: wait_osd_id_used_by_pgs 0 8 2026-02-17T12:55:21.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1484: wait_osd_id_used_by_pgs: local id=0 2026-02-17T12:55:21.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1485: wait_osd_id_used_by_pgs: local count=8 2026-02-17T12:55:21.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1487: wait_osd_id_used_by_pgs: status=1 2026-02-17T12:55:21.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1488: wait_osd_id_used_by_pgs: (( i=0 )) 2026-02-17T12:55:21.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1488: wait_osd_id_used_by_pgs: (( i < 300 / 5 )) 2026-02-17T12:55:21.089 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:55:21.090 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1489: wait_osd_id_used_by_pgs: echo 0 2026-02-17T12:55:21.090 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1490: wait_osd_id_used_by_pgs: get_osd_id_used_by_pgs 2026-02-17T12:55:21.090 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1490: wait_osd_id_used_by_pgs: grep -c 0 2026-02-17T12:55:21.090 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1455: get_osd_id_used_by_pgs: ceph --format json pg dump pgs 2026-02-17T12:55:21.090 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1455: get_osd_id_used_by_pgs: jq '.pg_stats | .[] | .up[], .acting[]' 2026-02-17T12:55:21.090 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1455: get_osd_id_used_by_pgs: sort 2026-02-17T12:55:21.273 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1490: wait_osd_id_used_by_pgs: test 8 = 8 2026-02-17T12:55:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1493: wait_osd_id_used_by_pgs: status=0 2026-02-17T12:55:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1494: wait_osd_id_used_by_pgs: break 2026-02-17T12:55:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1497: wait_osd_id_used_by_pgs: return 0 2026-02-17T12:55:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1510: test_wait_osd_id_used_by_pgs: TIMEOUT=1 2026-02-17T12:55:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1510: test_wait_osd_id_used_by_pgs: wait_osd_id_used_by_pgs 123 5 2026-02-17T12:55:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1484: wait_osd_id_used_by_pgs: local id=123 2026-02-17T12:55:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1485: wait_osd_id_used_by_pgs: local count=5 2026-02-17T12:55:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1487: wait_osd_id_used_by_pgs: status=1 2026-02-17T12:55:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1488: wait_osd_id_used_by_pgs: (( i=0 )) 2026-02-17T12:55:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1488: wait_osd_id_used_by_pgs: (( i < 1 / 5 )) 2026-02-17T12:55:21.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1497: wait_osd_id_used_by_pgs: return 1 2026-02-17T12:55:21.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1511: test_wait_osd_id_used_by_pgs: teardown td/ceph-helpers 2026-02-17T12:55:21.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2026-02-17T12:55:21.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:55:21.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2026-02-17T12:55:21.275 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:55:21.275 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:55:21.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:55:21.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:55:21.275 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:55:21.378 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:55:21.379 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:55:21.380 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:55:21.380 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:55:21.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:55:21.382 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:55:21.382 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:55:21.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:55:21.383 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:55:21.384 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:55:21.384 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:55:21.384 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:55:21.385 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:55:21.385 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2026-02-17T12:55:21.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:55:21.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:21.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.83920 2026-02-17T12:55:21.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.83920 2026-02-17T12:55:21.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:55:21.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:55:21.390 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2413: : exit 0 2026-02-17T12:55:21.392 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T12:55:21.392 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T12:55:21.458 INFO:tasks.workunit:Running workunit misc/test-snaptrim-stats.sh... 2026-02-17T12:55:21.459 DEBUG:teuthology.orchestra.run.trial155:workunit test misc/test-snaptrim-stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c96dfb3f50b3d02598a82af7104764bfdcd3919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh 2026-02-17T12:55:21.522 INFO:tasks.workunit.client.0.trial155.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T12:55:21.526 INFO:tasks.workunit.client.0.trial155.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T12:55:21.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:55:21.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:55:21.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T12:55:21.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T12:55:21.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T12:55:21.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T12:55:21.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T12:55:21.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T12:55:21.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/test-snaptrim-stats 2026-02-17T12:55:21.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:21: run: local dir=td/test-snaptrim-stats 2026-02-17T12:55:21.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:22: run: shift 2026-02-17T12:55:21.527 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:24: run: export CEPH_MON=127.0.0.1:7124 2026-02-17T12:55:21.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:24: run: CEPH_MON=127.0.0.1:7124 2026-02-17T12:55:21.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:25: run: export CEPH_ARGS 2026-02-17T12:55:21.528 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:26: run: uuidgen 2026-02-17T12:55:21.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:26: run: CEPH_ARGS+='--fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none ' 2026-02-17T12:55:21.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7124 ' 2026-02-17T12:55:21.528 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:28: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-17T12:55:21.530 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:30: run: set 2026-02-17T12:55:21.530 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:30: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T12:55:21.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:30: run: local 'funcs=TEST_snaptrim_stats 2026-02-17T12:55:21.530 INFO:tasks.workunit.client.0.trial155.stderr:TEST_snaptrim_stats_multiple_snaps' 2026-02-17T12:55:21.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:31: run: for func in $funcs 2026-02-17T12:55:21.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:32: run: setup td/test-snaptrim-stats 2026-02-17T12:55:21.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-snaptrim-stats 2026-02-17T12:55:21.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-snaptrim-stats 2026-02-17T12:55:21.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-snaptrim-stats 2026-02-17T12:55:21.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:55:21.531 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-17T12:55:21.531 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:55:21.531 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:55:21.531 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:55:21.531 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:55:21.531 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:55:21.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:55:21.532 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:55:21.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:55:21.532 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:55:21.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:55:21.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:55:21.533 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:55:21.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:55:21.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:55:21.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:55:21.534 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:55:21.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:55:21.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:55:21.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-snaptrim-stats 2026-02-17T12:55:21.536 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:55:21.537 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:21.537 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:55:21.537 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.175758 2026-02-17T12:55:21.538 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:55:21.538 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:55:21.538 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-snaptrim-stats 2026-02-17T12:55:21.539 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:55:21.539 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:21.539 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:55:21.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.175758 2026-02-17T12:55:21.540 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:55:21.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T12:55:21.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T12:55:21.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:55:21.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-snaptrim-stats 1' TERM HUP INT 2026-02-17T12:55:21.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:33: run: TEST_snaptrim_stats td/test-snaptrim-stats 2026-02-17T12:55:21.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:39: TEST_snaptrim_stats: local dir=td/test-snaptrim-stats 2026-02-17T12:55:21.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:40: TEST_snaptrim_stats: local poolname=test 2026-02-17T12:55:21.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:41: TEST_snaptrim_stats: local OSDS=3 2026-02-17T12:55:21.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:42: TEST_snaptrim_stats: local PGNUM=8 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:43: TEST_snaptrim_stats: local PGPNUM=8 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:44: TEST_snaptrim_stats: local objects=10 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:45: TEST_snaptrim_stats: local WAIT_FOR_UPDATE=10 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:47: TEST_snaptrim_stats: setup td/test-snaptrim-stats 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-snaptrim-stats 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-snaptrim-stats 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-snaptrim-stats 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:55:21.543 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:55:21.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:55:21.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:55:21.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:55:21.545 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:55:21.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:55:21.545 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:55:21.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:55:21.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:55:21.545 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:55:21.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:55:21.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:55:21.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:55:21.546 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:55:21.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:55:21.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:55:21.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-snaptrim-stats 2026-02-17T12:55:21.548 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:55:21.548 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:21.548 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:55:21.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.175758 2026-02-17T12:55:21.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:55:21.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:55:21.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-snaptrim-stats 2026-02-17T12:55:21.550 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:55:21.550 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:21.550 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:55:21.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.175758 2026-02-17T12:55:21.551 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:55:21.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:55:21.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:55:21.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-snaptrim-stats 1' TERM HUP INT 2026-02-17T12:55:21.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:48: TEST_snaptrim_stats: run_mon td/test-snaptrim-stats a --osd_pool_default_size=3 2026-02-17T12:55:21.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-snaptrim-stats 2026-02-17T12:55:21.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:55:21.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:55:21.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:55:21.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-snaptrim-stats/a 2026-02-17T12:55:21.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-snaptrim-stats/a --run-dir=td/test-snaptrim-stats --osd_pool_default_size=3 2026-02-17T12:55:21.572 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:55:21.572 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:55:21.572 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:55:21.572 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:55:21.572 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:21.572 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:55:21.572 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:55:21.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-snaptrim-stats/a '--log-file=td/test-snaptrim-stats/$name.log' '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --mon-cluster-log-file=td/test-snaptrim-stats/log --run-dir=td/test-snaptrim-stats '--pid-file=td/test-snaptrim-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-17T12:55:21.598 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:55:21.599 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:55:21.599 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:55:21.599 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:55:21.599 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:55:21.599 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:55:21.599 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:55:21.599 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:55:21.599 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:55:21.600 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:55:21.600 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:21.601 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:55:21.601 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.175758/ceph-mon.a.asok 2026-02-17T12:55:21.601 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:55:21.601 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.175758/ceph-mon.a.asok config get fsid 2026-02-17T12:55:21.647 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:55:21.648 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:55:21.648 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:55:21.648 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:55:21.648 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:55:21.648 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:55:21.648 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:55:21.648 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:55:21.648 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:55:21.648 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:21.648 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:55:21.648 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.175758/ceph-mon.a.asok 2026-02-17T12:55:21.649 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:55:21.649 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.175758/ceph-mon.a.asok config get mon_host 2026-02-17T12:55:21.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:49: TEST_snaptrim_stats: run_mgr td/test-snaptrim-stats x 2026-02-17T12:55:21.691 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-snaptrim-stats 2026-02-17T12:55:21.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:55:21.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:55:21.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:55:21.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-snaptrim-stats/x 2026-02-17T12:55:21.692 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:55:21.794 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:55:21.795 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:55:21.795 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:55:21.795 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:55:21.795 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:21.795 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:55:21.795 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:55:21.795 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:55:21.796 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-snaptrim-stats/x '--log-file=td/test-snaptrim-stats/$name.log' '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --run-dir=td/test-snaptrim-stats '--pid-file=td/test-snaptrim-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:55:21.811 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:50: TEST_snaptrim_stats: expr 3 - 1 2026-02-17T12:55:21.812 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:50: TEST_snaptrim_stats: seq 0 2 2026-02-17T12:55:21.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:50: TEST_snaptrim_stats: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T12:55:21.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:52: TEST_snaptrim_stats: run_osd td/test-snaptrim-stats 0 --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:55:21.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-snaptrim-stats 2026-02-17T12:55:21.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:55:21.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:55:21.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:55:21.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-snaptrim-stats/0 2026-02-17T12:55:21.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/0' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/0/journal' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:55:21.820 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-snaptrim-stats/0 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=46bd390a-da30-46a5-ad86-f36f7ef2356b 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 46bd390a-da30-46a5-ad86-f36f7ef2356b' 2026-02-17T12:55:21.821 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 46bd390a-da30-46a5-ad86-f36f7ef2356b 2026-02-17T12:55:21.822 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:55:21.827 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA5ZZRpr6UwMRAALj3r2E5+T6CfOAmsOsBf1A== 2026-02-17T12:55:21.827 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA5ZZRpr6UwMRAALj3r2E5+T6CfOAmsOsBf1A=="}' 2026-02-17T12:55:21.827 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 46bd390a-da30-46a5-ad86-f36f7ef2356b -i td/test-snaptrim-stats/0/new.json 2026-02-17T12:55:21.931 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:55:21.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-snaptrim-stats/0/new.json 2026-02-17T12:55:21.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/0 --osd-journal=td/test-snaptrim-stats/0/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQA5ZZRpr6UwMRAALj3r2E5+T6CfOAmsOsBf1A== --osd-uuid 46bd390a-da30-46a5-ad86-f36f7ef2356b 2026-02-17T12:55:21.957 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:21.954+0000 7fce46816780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:21.958 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:21.956+0000 7fce46816780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:21.959 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:21.957+0000 7fce46816780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:21.960 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:21.957+0000 7fce46816780 -1 bdev(0x560d51603c00 td/test-snaptrim-stats/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:55:21.960 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:21.957+0000 7fce46816780 -1 bluestore(td/test-snaptrim-stats/0) _read_fsid unparsable uuid 2026-02-17T12:55:24.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-snaptrim-stats/0/keyring 2026-02-17T12:55:24.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:55:24.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:55:24.612 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:55:24.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-snaptrim-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:55:24.868 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:55:24.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:55:24.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/0 --osd-journal=td/test-snaptrim-stats/0/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:55:24.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:55:24.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:55:24.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:55:24.886 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:24.883+0000 7f801678d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:24.887 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:24.885+0000 7f801678d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:24.888 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:24.886+0000 7f801678d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:25.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:55:25.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:55:25.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:55:25.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:55:25.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:55:25.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:25.058 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:55:25.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:55:25.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:25.059 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:55:25.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:25.971 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:25.969+0000 7f801678d780 -1 Falling back to public interface 2026-02-17T12:55:26.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:26.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:26.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:55:26.247 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:55:26.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:26.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:55:26.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:27.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:27.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:27.439 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:55:27.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:55:27.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:27.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:55:27.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:28.634 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:28.634 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:28.635 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:55:28.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:55:28.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:28.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:55:28.829 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:28.903 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:28.901+0000 7f801678d780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:55:29.830 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:29.830 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:29.831 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:55:29.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:55:29.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:29.832 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:55:30.017 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3460919203,v1:127.0.0.1:6803/3460919203] [v2:127.0.0.1:6804/3460919203,v1:127.0.0.1:6805/3460919203] exists,up 46bd390a-da30-46a5-ad86-f36f7ef2356b 2026-02-17T12:55:30.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:55:30.021 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:55:30.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:55:30.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:50: TEST_snaptrim_stats: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T12:55:30.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:52: TEST_snaptrim_stats: run_osd td/test-snaptrim-stats 1 --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:55:30.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-snaptrim-stats 2026-02-17T12:55:30.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:55:30.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:55:30.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:55:30.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-snaptrim-stats/1 2026-02-17T12:55:30.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-17T12:55:30.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:55:30.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/1' 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/1/journal' 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:55:30.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:55:30.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:55:30.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-snaptrim-stats/1 2026-02-17T12:55:30.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:55:30.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4b0e058b-0932-48bb-ae24-352c7c980619 2026-02-17T12:55:30.025 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 4b0e058b-0932-48bb-ae24-352c7c980619' 2026-02-17T12:55:30.025 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 4b0e058b-0932-48bb-ae24-352c7c980619 2026-02-17T12:55:30.025 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:55:30.032 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBCZZRpuojgARAAAEBmsRZ8vatmNQvUswIaPw== 2026-02-17T12:55:30.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBCZZRpuojgARAAAEBmsRZ8vatmNQvUswIaPw=="}' 2026-02-17T12:55:30.033 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4b0e058b-0932-48bb-ae24-352c7c980619 -i td/test-snaptrim-stats/1/new.json 2026-02-17T12:55:30.226 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:55:30.233 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-snaptrim-stats/1/new.json 2026-02-17T12:55:30.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/1 --osd-journal=td/test-snaptrim-stats/1/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQBCZZRpuojgARAAAEBmsRZ8vatmNQvUswIaPw== --osd-uuid 4b0e058b-0932-48bb-ae24-352c7c980619 2026-02-17T12:55:30.252 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:30.250+0000 7fcabac1e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:30.253 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:30.251+0000 7fcabac1e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:30.254 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:30.252+0000 7fcabac1e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:30.255 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:30.252+0000 7fcabac1e780 -1 bdev(0x561e4f5f3c00 td/test-snaptrim-stats/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:55:30.255 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:30.252+0000 7fcabac1e780 -1 bluestore(td/test-snaptrim-stats/1) _read_fsid unparsable uuid 2026-02-17T12:55:32.379 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-snaptrim-stats/1/keyring 2026-02-17T12:55:32.380 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:55:32.380 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:55:32.381 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:55:32.381 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-snaptrim-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:55:32.636 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:55:32.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:55:32.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/1 --osd-journal=td/test-snaptrim-stats/1/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:55:32.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:55:32.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:55:32.637 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:55:32.653 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:32.651+0000 7fcb224fe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:32.654 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:32.652+0000 7fcb224fe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:32.655 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:32.653+0000 7fcb224fe780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:32.823 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:55:32.823 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:55:32.823 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:55:32.824 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:55:32.824 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:55:32.824 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:32.824 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:55:32.824 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:55:32.825 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:32.825 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:55:33.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:34.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:34.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:34.014 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:55:34.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:55:34.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:34.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:55:34.202 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:34.245 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:34.242+0000 7fcb224fe780 -1 Falling back to public interface 2026-02-17T12:55:35.202 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:35.203 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:35.203 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:55:35.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:55:35.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:35.204 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:55:35.393 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:36.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:36.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:36.395 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:55:36.395 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:55:36.396 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:36.396 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:55:36.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:37.177 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:37.175+0000 7fcb224fe780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:55:37.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:37.582 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:37.582 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:55:37.583 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:55:37.583 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:37.583 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:55:37.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:38.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:38.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:38.778 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:55:38.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:55:38.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:38.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:55:38.970 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1138356240,v1:127.0.0.1:6811/1138356240] [v2:127.0.0.1:6812/1138356240,v1:127.0.0.1:6813/1138356240] exists,up 4b0e058b-0932-48bb-ae24-352c7c980619 2026-02-17T12:55:38.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:55:38.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:55:38.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:50: TEST_snaptrim_stats: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:52: TEST_snaptrim_stats: run_osd td/test-snaptrim-stats 2 --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-snaptrim-stats 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-snaptrim-stats/2 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:55:38.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/2' 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/2/journal' 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:55:38.976 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:55:38.977 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-snaptrim-stats/2 2026-02-17T12:55:38.978 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:55:38.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=47265393-c04f-4b75-9ded-55557d3a9dc3 2026-02-17T12:55:38.978 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 47265393-c04f-4b75-9ded-55557d3a9dc3 2026-02-17T12:55:38.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 47265393-c04f-4b75-9ded-55557d3a9dc3' 2026-02-17T12:55:38.978 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:55:38.986 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBKZZRpjoO4OhAAOyXE/Yoa2OM5/5KRKA2/BQ== 2026-02-17T12:55:38.986 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBKZZRpjoO4OhAAOyXE/Yoa2OM5/5KRKA2/BQ=="}' 2026-02-17T12:55:38.987 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 47265393-c04f-4b75-9ded-55557d3a9dc3 -i td/test-snaptrim-stats/2/new.json 2026-02-17T12:55:39.179 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:55:39.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-snaptrim-stats/2/new.json 2026-02-17T12:55:39.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/2 --osd-journal=td/test-snaptrim-stats/2/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQBKZZRpjoO4OhAAOyXE/Yoa2OM5/5KRKA2/BQ== --osd-uuid 47265393-c04f-4b75-9ded-55557d3a9dc3 2026-02-17T12:55:39.204 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:39.202+0000 7fd4bb014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:39.205 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:39.203+0000 7fd4bb014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:39.206 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:39.204+0000 7fd4bb014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:39.207 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:39.204+0000 7fd4bb014780 -1 bdev(0x557b4af3bc00 td/test-snaptrim-stats/2/block) open stat got: (1) Operation not permitted 2026-02-17T12:55:39.207 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:39.204+0000 7fd4bb014780 -1 bluestore(td/test-snaptrim-stats/2) _read_fsid unparsable uuid 2026-02-17T12:55:41.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-snaptrim-stats/2/keyring 2026-02-17T12:55:41.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:55:41.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:55:41.331 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:55:41.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-snaptrim-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:55:41.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:55:41.588 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:55:41.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/2 --osd-journal=td/test-snaptrim-stats/2/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:55:41.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:55:41.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:55:41.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:55:41.605 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:41.602+0000 7fee5322e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:41.606 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:41.604+0000 7fee5322e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:41.607 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:41.605+0000 7fee5322e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:55:41.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:55:41.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:55:41.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:55:41.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:55:41.776 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:55:41.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:41.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:55:41.777 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:55:41.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:41.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:55:41.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:42.968 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:42.968 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:42.968 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:55:42.969 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:55:42.969 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:42.969 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:55:43.157 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:43.188 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:43.185+0000 7fee5322e780 -1 Falling back to public interface 2026-02-17T12:55:44.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:44.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:44.159 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:55:44.159 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:55:44.159 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:44.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:55:44.346 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:45.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:45.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:45.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:55:45.348 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:55:45.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:45.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:55:45.538 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:46.139 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:55:46.136+0000 7fee5322e780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:55:46.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:46.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:46.540 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:55:46.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:55:46.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:46.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:55:46.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:55:47.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:55:47.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:55:47.740 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:55:47.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:55:47.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:55:47.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:55:47.928 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2911826416,v1:127.0.0.1:6819/2911826416] [v2:127.0.0.1:6820/2911826416,v1:127.0.0.1:6821/2911826416] exists,up 47265393-c04f-4b75-9ded-55557d3a9dc3 2026-02-17T12:55:47.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:55:47.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:55:47.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:55:47.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:56: TEST_snaptrim_stats: ceph osd set noscrub 2026-02-17T12:55:48.220 INFO:tasks.workunit.client.0.trial155.stderr:noscrub is set 2026-02-17T12:55:48.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:57: TEST_snaptrim_stats: ceph osd set nodeep-scrub 2026-02-17T12:55:48.524 INFO:tasks.workunit.client.0.trial155.stderr:nodeep-scrub is set 2026-02-17T12:55:48.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:60: TEST_snaptrim_stats: create_pool test 8 8 2026-02-17T12:55:48.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 8 8 2026-02-17T12:55:48.775 INFO:tasks.workunit.client.0.trial155.stderr:pool 'test' already exists 2026-02-17T12:55:48.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:55:49.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:61: TEST_snaptrim_stats: wait_for_clean 2026-02-17T12:55:49.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:55:49.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:55:49.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:55:49.786 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:55:49.786 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:55:49.786 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:55:49.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:55:49.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:55:49.787 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:55:49.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:55:49.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:55:49.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:55:49.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:55:49.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:55:49.871 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:55:50.063 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:55:50.064 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:55:50.064 INFO:tasks.workunit.client.0.trial155.stderr:2' 2026-02-17T12:55:50.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:55:50.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:55:50.064 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:55:50.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836487 2026-02-17T12:55:50.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836487 2026-02-17T12:55:50.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T12:55:50.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:55:50.125 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:55:50.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705669 2026-02-17T12:55:50.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705669 2026-02-17T12:55:50.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-38654705669' 2026-02-17T12:55:50.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:55:50.187 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:55:50.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542147 2026-02-17T12:55:50.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542147 2026-02-17T12:55:50.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-38654705669 2-60129542147' 2026-02-17T12:55:50.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:55:50.248 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836487 2026-02-17T12:55:50.248 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:55:50.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:55:50.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836487 2026-02-17T12:55:50.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:55:50.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836487 2026-02-17T12:55:50.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T12:55:50.251 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836487 2026-02-17T12:55:50.252 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:55:50.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836484 -lt 21474836487 2026-02-17T12:55:50.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:55:51.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:55:51.443 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:55:51.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836484 -lt 21474836487 2026-02-17T12:55:51.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:55:52.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T12:55:52.633 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:55:52.828 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T12:55:52.828 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:55:52.829 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705669 2026-02-17T12:55:52.829 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:55:52.830 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:55:52.830 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705669 2026-02-17T12:55:52.831 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:55:52.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705669 2026-02-17T12:55:52.832 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T12:55:52.832 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 38654705669 2026-02-17T12:55:52.832 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:55:53.016 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-17T12:55:53.016 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:55:53.017 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542147 2026-02-17T12:55:53.017 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:55:53.017 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:55:53.018 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542147 2026-02-17T12:55:53.018 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:55:53.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542147 2026-02-17T12:55:53.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T12:55:53.020 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 60129542147 2026-02-17T12:55:53.020 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:55:53.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T12:55:53.220 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:55:53.220 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:55:53.220 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:55:53.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 == 0 2026-02-17T12:55:53.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:55:53.476 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:55:53.476 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:55:53.476 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:55:53.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:55:53.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:55:53.477 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:55:53.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=8 2026-02-17T12:55:53.662 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:55:53.662 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:55:53.662 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:55:53.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 8 = 8 2026-02-17T12:55:53.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:55:53.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:55:53.914 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:62: TEST_snaptrim_stats: ceph osd dump 2026-02-17T12:55:53.915 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:62: TEST_snaptrim_stats: grep '^pool.*['\'']test['\'']' 2026-02-17T12:55:53.915 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:62: TEST_snaptrim_stats: awk '{ print $2 }' 2026-02-17T12:55:54.100 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:62: TEST_snaptrim_stats: poolid=1 2026-02-17T12:55:54.100 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:65: TEST_snaptrim_stats: TESTDATA=testdata.1 2026-02-17T12:55:54.101 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:66: TEST_snaptrim_stats: dd if=/dev/urandom of=testdata.1 bs=4096 count=1 2026-02-17T12:55:54.101 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records in 2026-02-17T12:55:54.101 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records out 2026-02-17T12:55:54.101 INFO:tasks.workunit.client.0.trial155.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 4.2179e-05 s, 97.1 MB/s 2026-02-17T12:55:54.102 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: seq 1 10 2026-02-17T12:55:54.102 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.102 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj1 testdata.1 2026-02-17T12:55:54.121 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj2 testdata.1 2026-02-17T12:55:54.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj3 testdata.1 2026-02-17T12:55:54.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj4 testdata.1 2026-02-17T12:55:54.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj5 testdata.1 2026-02-17T12:55:54.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj6 testdata.1 2026-02-17T12:55:54.211 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.211 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj7 testdata.1 2026-02-17T12:55:54.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.228 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj8 testdata.1 2026-02-17T12:55:54.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj9 testdata.1 2026-02-17T12:55:54.262 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:67: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.263 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:69: TEST_snaptrim_stats: rados -p test put obj10 testdata.1 2026-02-17T12:55:54.279 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:71: TEST_snaptrim_stats: rm -f testdata.1 2026-02-17T12:55:54.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:74: TEST_snaptrim_stats: SNAP=1 2026-02-17T12:55:54.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:75: TEST_snaptrim_stats: rados -p test mksnap snap1 2026-02-17T12:55:54.347 INFO:tasks.workunit.client.0.trial155.stdout:created pool test snap snap1 2026-02-17T12:55:54.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:76: TEST_snaptrim_stats: TESTDATA=testdata.2 2026-02-17T12:55:54.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:77: TEST_snaptrim_stats: dd if=/dev/urandom of=testdata.2 bs=4096 count=1 2026-02-17T12:55:54.349 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records in 2026-02-17T12:55:54.349 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records out 2026-02-17T12:55:54.349 INFO:tasks.workunit.client.0.trial155.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 4.5966e-05 s, 89.1 MB/s 2026-02-17T12:55:54.349 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: seq 1 10 2026-02-17T12:55:54.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj1 testdata.2 2026-02-17T12:55:54.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.370 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj2 testdata.2 2026-02-17T12:55:54.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj3 testdata.2 2026-02-17T12:55:54.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.407 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj4 testdata.2 2026-02-17T12:55:54.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj5 testdata.2 2026-02-17T12:55:54.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj6 testdata.2 2026-02-17T12:55:54.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj7 testdata.2 2026-02-17T12:55:54.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.478 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj8 testdata.2 2026-02-17T12:55:54.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.496 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj9 testdata.2 2026-02-17T12:55:54.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:78: TEST_snaptrim_stats: for i in `seq 1 $objects` 2026-02-17T12:55:54.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:80: TEST_snaptrim_stats: rados -p test put obj10 testdata.2 2026-02-17T12:55:54.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:82: TEST_snaptrim_stats: rm -f testdata.2 2026-02-17T12:55:54.533 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:85: TEST_snaptrim_stats: rados -p test rmsnap snap1 2026-02-17T12:55:54.600 INFO:tasks.workunit.client.0.trial155.stdout:removed pool test snap snap1 2026-02-17T12:55:54.603 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:88: TEST_snaptrim_stats: wait_for_clean 2026-02-17T12:55:54.603 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:55:54.603 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:55:54.603 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:55:54.604 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:55:54.604 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:55:54.604 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:55:54.604 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:55:54.604 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:55:54.604 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:55:54.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:55:54.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:55:54.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:55:54.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:55:54.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:55:54.685 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:55:54.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:55:54.873 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:55:54.873 INFO:tasks.workunit.client.0.trial155.stderr:2' 2026-02-17T12:55:54.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:55:54.873 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:55:54.874 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:55:54.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836489 2026-02-17T12:55:54.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836489 2026-02-17T12:55:54.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489' 2026-02-17T12:55:54.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:55:54.938 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:55:54.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705672 2026-02-17T12:55:54.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705672 2026-02-17T12:55:54.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489 1-38654705672' 2026-02-17T12:55:54.998 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:55:54.999 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:55:55.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542150 2026-02-17T12:55:55.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542150 2026-02-17T12:55:55.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489 1-38654705672 2-60129542150' 2026-02-17T12:55:55.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:55:55.062 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836489 2026-02-17T12:55:55.062 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:55:55.062 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:55:55.063 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836489 2026-02-17T12:55:55.063 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:55:55.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836489 2026-02-17T12:55:55.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2026-02-17T12:55:55.065 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836489 2026-02-17T12:55:55.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:55:55.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836489 2026-02-17T12:55:55.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:55:56.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:55:56.253 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:55:56.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836490 -lt 21474836489 2026-02-17T12:55:56.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:55:56.442 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705672 2026-02-17T12:55:56.442 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:55:56.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:55:56.444 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705672 2026-02-17T12:55:56.444 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:55:56.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705672 2026-02-17T12:55:56.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-17T12:55:56.445 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 38654705672 2026-02-17T12:55:56.446 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:55:56.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-17T12:55:56.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:55:56.636 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542150 2026-02-17T12:55:56.636 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:55:56.636 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:55:56.637 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542150 2026-02-17T12:55:56.637 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:55:56.638 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542150 2026-02-17T12:55:56.639 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T12:55:56.639 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 60129542150 2026-02-17T12:55:56.639 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:55:56.825 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T12:55:56.826 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:55:56.826 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:55:56.826 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:55:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 == 0 2026-02-17T12:55:57.079 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:55:57.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:55:57.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:55:57.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:55:57.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:55:57.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:55:57.080 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:55:57.263 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=8 2026-02-17T12:55:57.263 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:55:57.264 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:55:57.264 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:55:57.516 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 8 = 8 2026-02-17T12:55:57.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:55:57.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:55:57.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:89: TEST_snaptrim_stats: sleep 10 2026-02-17T12:56:07.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:90: TEST_snaptrim_stats: local objects_trimmed=0 2026-02-17T12:56:07.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:91: TEST_snaptrim_stats: local snaptrim_duration_total=0.0 2026-02-17T12:56:07.518 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: expr 8 - 1 2026-02-17T12:56:07.519 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: seq 0 7 2026-02-17T12:56:07.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:07.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.0 2026-02-17T12:56:07.522 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.0 query 2026-02-17T12:56:07.522 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-17T12:56:07.588 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 0 + 2 2026-02-17T12:56:07.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=2 2026-02-17T12:56:07.590 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-17T12:56:07.590 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.0 query 2026-02-17T12:56:07.591 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-17T12:56:07.654 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo 0.0 + 0.003689557 2026-02-17T12:56:07.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.003689557 2026-02-17T12:56:07.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:07.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.1 2026-02-17T12:56:07.655 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.1 query 2026-02-17T12:56:07.655 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-17T12:56:07.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 2 + 2 2026-02-17T12:56:07.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=4 2026-02-17T12:56:07.720 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-17T12:56:07.721 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.1 query 2026-02-17T12:56:07.721 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-17T12:56:07.784 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .003689557 + 0.0019073409999999999 2026-02-17T12:56:07.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.0055968979999999999 2026-02-17T12:56:07.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:07.785 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.2 2026-02-17T12:56:07.786 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.2 query 2026-02-17T12:56:07.786 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-17T12:56:07.848 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 4 + 0 2026-02-17T12:56:07.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=4 2026-02-17T12:56:07.850 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-17T12:56:07.850 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.2 query 2026-02-17T12:56:07.850 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-17T12:56:07.914 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .0055968979999999999 + 0.00077877800000000004 2026-02-17T12:56:07.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.00637567599999999994 2026-02-17T12:56:07.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:07.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.3 2026-02-17T12:56:07.916 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.3 query 2026-02-17T12:56:07.916 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-17T12:56:07.978 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 4 + 2 2026-02-17T12:56:07.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=6 2026-02-17T12:56:07.980 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-17T12:56:07.980 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.3 query 2026-02-17T12:56:07.981 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-17T12:56:08.043 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .00637567599999999994 + 0.0016904349999999999 2026-02-17T12:56:08.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.00806611099999999984 2026-02-17T12:56:08.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:08.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.4 2026-02-17T12:56:08.044 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.4 query 2026-02-17T12:56:08.045 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-17T12:56:08.109 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 6 + 1 2026-02-17T12:56:08.110 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=7 2026-02-17T12:56:08.111 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-17T12:56:08.111 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.4 query 2026-02-17T12:56:08.112 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-17T12:56:08.173 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .00806611099999999984 + 0.0016192019999999999 2026-02-17T12:56:08.174 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.00968531299999999974 2026-02-17T12:56:08.174 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:08.174 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.5 2026-02-17T12:56:08.175 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.5 query 2026-02-17T12:56:08.175 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-17T12:56:08.239 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 7 + 1 2026-02-17T12:56:08.240 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=8 2026-02-17T12:56:08.241 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-17T12:56:08.241 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.5 query 2026-02-17T12:56:08.242 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-17T12:56:08.306 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .00968531299999999974 + 0.001529554 2026-02-17T12:56:08.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.01121486699999999974 2026-02-17T12:56:08.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:08.307 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.6 2026-02-17T12:56:08.307 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.6 query 2026-02-17T12:56:08.307 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-17T12:56:08.371 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 8 + 0 2026-02-17T12:56:08.372 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=8 2026-02-17T12:56:08.373 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-17T12:56:08.374 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.6 query 2026-02-17T12:56:08.374 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-17T12:56:08.436 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .01121486699999999974 + 0.001790713 2026-02-17T12:56:08.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.01300557999999999974 2026-02-17T12:56:08.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:92: TEST_snaptrim_stats: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:08.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:94: TEST_snaptrim_stats: local pgid=1.7 2026-02-17T12:56:08.438 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: ceph pg 1.7 query 2026-02-17T12:56:08.438 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: jq .info.stats.objects_trimmed 2026-02-17T12:56:08.504 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: expr 8 + 2 2026-02-17T12:56:08.505 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:96: TEST_snaptrim_stats: objects_trimmed=10 2026-02-17T12:56:08.505 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: bc 2026-02-17T12:56:08.506 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: ceph pg 1.7 query 2026-02-17T12:56:08.506 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: jq .info.stats.snaptrim_duration 2026-02-17T12:56:08.570 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: echo .01300557999999999974 + 0.003400878 2026-02-17T12:56:08.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:98: TEST_snaptrim_stats: snaptrim_duration_total=.01640645799999999974 2026-02-17T12:56:08.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:100: TEST_snaptrim_stats: test 10 -eq 10 2026-02-17T12:56:08.571 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:101: TEST_snaptrim_stats: echo '.01640645799999999974 > 0.0' 2026-02-17T12:56:08.571 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:101: TEST_snaptrim_stats: bc 2026-02-17T12:56:08.571 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:56:08.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:103: TEST_snaptrim_stats: teardown td/test-snaptrim-stats 2026-02-17T12:56:08.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-snaptrim-stats 2026-02-17T12:56:08.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:56:08.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-17T12:56:08.573 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:56:08.573 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:56:08.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:56:08.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:56:08.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:56:08.680 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:56:08.681 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:56:08.682 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:56:08.682 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:56:08.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:56:08.683 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:56:08.684 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:56:08.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:56:08.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:56:08.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:56:08.685 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:56:08.686 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:56:08.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:56:08.687 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-snaptrim-stats 2026-02-17T12:56:08.714 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:56:08.714 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:08.714 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:08.715 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.175758 2026-02-17T12:56:08.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:56:08.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:56:08.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:34: run: teardown td/test-snaptrim-stats 2026-02-17T12:56:08.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-snaptrim-stats 2026-02-17T12:56:08.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:56:08.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-17T12:56:08.717 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:56:08.717 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:56:08.717 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:56:08.717 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:56:08.717 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:56:08.717 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:56:08.718 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:56:08.718 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:56:08.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:56:08.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:56:08.720 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:56:08.720 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:56:08.721 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:56:08.721 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:56:08.721 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:56:08.721 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:56:08.722 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:56:08.723 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:56:08.723 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-snaptrim-stats 2026-02-17T12:56:08.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:56:08.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:08.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:08.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.175758 2026-02-17T12:56:08.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:56:08.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:56:08.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:31: run: for func in $funcs 2026-02-17T12:56:08.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:32: run: setup td/test-snaptrim-stats 2026-02-17T12:56:08.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-snaptrim-stats 2026-02-17T12:56:08.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-snaptrim-stats 2026-02-17T12:56:08.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-snaptrim-stats 2026-02-17T12:56:08.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:56:08.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-17T12:56:08.726 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:56:08.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:56:08.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:56:08.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:56:08.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:56:08.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:56:08.727 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:56:08.728 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:56:08.728 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:56:08.729 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:56:08.729 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:56:08.729 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:56:08.730 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:56:08.730 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:56:08.730 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:56:08.731 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:56:08.731 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:56:08.732 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:56:08.732 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-snaptrim-stats 2026-02-17T12:56:08.733 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:56:08.733 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:08.734 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:08.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.175758 2026-02-17T12:56:08.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:56:08.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:56:08.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-snaptrim-stats 2026-02-17T12:56:08.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:56:08.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:08.736 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:08.736 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.175758 2026-02-17T12:56:08.737 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:56:08.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:56:08.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:56:08.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-snaptrim-stats 1' TERM HUP INT 2026-02-17T12:56:08.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:33: run: TEST_snaptrim_stats_multiple_snaps td/test-snaptrim-stats 2026-02-17T12:56:08.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:107: TEST_snaptrim_stats_multiple_snaps: local dir=td/test-snaptrim-stats 2026-02-17T12:56:08.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:108: TEST_snaptrim_stats_multiple_snaps: local poolname=test 2026-02-17T12:56:08.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:109: TEST_snaptrim_stats_multiple_snaps: local OSDS=3 2026-02-17T12:56:08.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:110: TEST_snaptrim_stats_multiple_snaps: local PGNUM=8 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:111: TEST_snaptrim_stats_multiple_snaps: local PGPNUM=8 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:112: TEST_snaptrim_stats_multiple_snaps: local objects=10 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:113: TEST_snaptrim_stats_multiple_snaps: local WAIT_FOR_UPDATE=10 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:115: TEST_snaptrim_stats_multiple_snaps: setup td/test-snaptrim-stats 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-snaptrim-stats 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-snaptrim-stats 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-snaptrim-stats 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:56:08.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:56:08.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:56:08.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:56:08.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:56:08.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:56:08.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:56:08.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:56:08.742 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:56:08.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:56:08.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:56:08.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:56:08.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:56:08.743 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:56:08.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:56:08.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:56:08.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-snaptrim-stats 2026-02-17T12:56:08.746 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:56:08.746 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:08.746 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:08.746 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.175758 2026-02-17T12:56:08.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:56:08.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:56:08.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-snaptrim-stats 2026-02-17T12:56:08.748 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:56:08.748 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:08.748 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:08.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.175758 2026-02-17T12:56:08.749 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:56:08.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:56:08.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:56:08.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-snaptrim-stats 1' TERM HUP INT 2026-02-17T12:56:08.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:116: TEST_snaptrim_stats_multiple_snaps: run_mon td/test-snaptrim-stats a --osd_pool_default_size=3 2026-02-17T12:56:08.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-snaptrim-stats 2026-02-17T12:56:08.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:56:08.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:56:08.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:56:08.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-snaptrim-stats/a 2026-02-17T12:56:08.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-snaptrim-stats/a --run-dir=td/test-snaptrim-stats --osd_pool_default_size=3 2026-02-17T12:56:08.771 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:56:08.771 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:56:08.771 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:56:08.771 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:56:08.771 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:08.771 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:08.771 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:56:08.771 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-snaptrim-stats/a '--log-file=td/test-snaptrim-stats/$name.log' '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --mon-cluster-log-file=td/test-snaptrim-stats/log --run-dir=td/test-snaptrim-stats '--pid-file=td/test-snaptrim-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-17T12:56:08.797 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:56:08.798 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:56:08.798 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:56:08.798 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:56:08.798 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:56:08.798 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:56:08.799 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:56:08.799 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:56:08.799 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:56:08.800 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:56:08.800 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:08.800 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:08.800 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.175758/ceph-mon.a.asok 2026-02-17T12:56:08.800 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:56:08.800 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.175758/ceph-mon.a.asok config get fsid 2026-02-17T12:56:08.845 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:56:08.845 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:56:08.845 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:56:08.845 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:56:08.845 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:56:08.846 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:56:08.846 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:56:08.847 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:56:08.847 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:56:08.847 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:08.847 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:08.847 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.175758/ceph-mon.a.asok 2026-02-17T12:56:08.847 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:56:08.847 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.175758/ceph-mon.a.asok config get mon_host 2026-02-17T12:56:08.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:117: TEST_snaptrim_stats_multiple_snaps: run_mgr td/test-snaptrim-stats x 2026-02-17T12:56:08.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-snaptrim-stats 2026-02-17T12:56:08.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:56:08.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:56:08.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:56:08.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-snaptrim-stats/x 2026-02-17T12:56:08.890 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:56:08.990 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:56:08.990 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:56:08.990 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:56:08.990 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:56:08.990 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:08.990 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:08.990 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:56:08.991 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:56:08.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-snaptrim-stats/x '--log-file=td/test-snaptrim-stats/$name.log' '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --run-dir=td/test-snaptrim-stats '--pid-file=td/test-snaptrim-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:56:09.008 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:118: TEST_snaptrim_stats_multiple_snaps: expr 3 - 1 2026-02-17T12:56:09.009 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:118: TEST_snaptrim_stats_multiple_snaps: seq 0 2 2026-02-17T12:56:09.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:118: TEST_snaptrim_stats_multiple_snaps: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T12:56:09.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:120: TEST_snaptrim_stats_multiple_snaps: run_osd td/test-snaptrim-stats 0 --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-snaptrim-stats 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-snaptrim-stats/0 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/0' 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/0/journal' 2026-02-17T12:56:09.013 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:56:09.014 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:56:09.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:56:09.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-17T12:56:09.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-17T12:56:09.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:56:09.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:56:09.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:56:09.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:56:09.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:56:09.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:56:09.015 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-snaptrim-stats/0 2026-02-17T12:56:09.015 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:56:09.016 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=bc1dc009-6806-4175-8ef4-1333c1552d8f 2026-02-17T12:56:09.016 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 bc1dc009-6806-4175-8ef4-1333c1552d8f' 2026-02-17T12:56:09.016 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 bc1dc009-6806-4175-8ef4-1333c1552d8f 2026-02-17T12:56:09.017 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:56:09.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBpZZRpT/dyARAA2Ikeh0atvMhazZdYcJqa+A== 2026-02-17T12:56:09.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBpZZRpT/dyARAA2Ikeh0atvMhazZdYcJqa+A=="}' 2026-02-17T12:56:09.026 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new bc1dc009-6806-4175-8ef4-1333c1552d8f -i td/test-snaptrim-stats/0/new.json 2026-02-17T12:56:09.130 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:56:09.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-snaptrim-stats/0/new.json 2026-02-17T12:56:09.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/0 --osd-journal=td/test-snaptrim-stats/0/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQBpZZRpT/dyARAA2Ikeh0atvMhazZdYcJqa+A== --osd-uuid bc1dc009-6806-4175-8ef4-1333c1552d8f 2026-02-17T12:56:09.155 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:09.154+0000 7fcbb680b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:09.156 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:09.155+0000 7fcbb680b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:09.157 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:09.156+0000 7fcbb680b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:09.158 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:09.156+0000 7fcbb680b780 -1 bdev(0x55bbd4c11c00 td/test-snaptrim-stats/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:56:09.158 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:09.156+0000 7fcbb680b780 -1 bluestore(td/test-snaptrim-stats/0) _read_fsid unparsable uuid 2026-02-17T12:56:12.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-snaptrim-stats/0/keyring 2026-02-17T12:56:12.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:56:12.054 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:56:12.054 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:56:12.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-snaptrim-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:56:12.310 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:56:12.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:56:12.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/0 --osd-journal=td/test-snaptrim-stats/0/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:56:12.311 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:56:12.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:56:12.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:56:12.326 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:12.325+0000 7f7527216780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:12.328 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:12.327+0000 7f7527216780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:12.329 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:12.327+0000 7f7527216780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:12.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:56:12.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:56:12.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:56:12.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:56:12.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:56:12.506 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:12.507 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:56:12.507 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:56:12.507 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:12.507 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:56:12.696 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:13.697 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:13.697 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:13.697 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:56:13.697 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:56:13.698 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:13.698 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:56:13.886 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:13.916 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:13.914+0000 7f7527216780 -1 Falling back to public interface 2026-02-17T12:56:14.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:14.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:14.888 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:56:14.888 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:56:14.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:14.889 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:56:15.075 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:16.076 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:16.077 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:16.077 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:56:16.077 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:56:16.078 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:16.078 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:56:16.265 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:16.865 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:16.864+0000 7f7527216780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:56:17.266 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:17.267 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:17.267 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:56:17.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:56:17.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:17.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:56:17.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:18.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:18.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:18.460 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:56:18.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:56:18.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:18.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:56:18.655 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2336972266,v1:127.0.0.1:6803/2336972266] [v2:127.0.0.1:6804/2336972266,v1:127.0.0.1:6805/2336972266] exists,up bc1dc009-6806-4175-8ef4-1333c1552d8f 2026-02-17T12:56:18.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:56:18.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:56:18.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:56:18.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:118: TEST_snaptrim_stats_multiple_snaps: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T12:56:18.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:120: TEST_snaptrim_stats_multiple_snaps: run_osd td/test-snaptrim-stats 1 --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:56:18.659 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-snaptrim-stats 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-snaptrim-stats/1 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/1' 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/1/journal' 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:56:18.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:56:18.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:56:18.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-17T12:56:18.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-17T12:56:18.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:56:18.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:56:18.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:56:18.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:56:18.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:56:18.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:56:18.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-snaptrim-stats/1 2026-02-17T12:56:18.662 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:56:18.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=58e69894-5ce0-443c-b371-03504011bcc1 2026-02-17T12:56:18.663 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 58e69894-5ce0-443c-b371-03504011bcc1 2026-02-17T12:56:18.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 58e69894-5ce0-443c-b371-03504011bcc1' 2026-02-17T12:56:18.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:56:18.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQByZZRpkBHeJxAAMH90vdQl1Awf0JWSbxKE+g== 2026-02-17T12:56:18.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQByZZRpkBHeJxAAMH90vdQl1Awf0JWSbxKE+g=="}' 2026-02-17T12:56:18.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 58e69894-5ce0-443c-b371-03504011bcc1 -i td/test-snaptrim-stats/1/new.json 2026-02-17T12:56:18.863 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:56:18.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-snaptrim-stats/1/new.json 2026-02-17T12:56:18.871 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/1 --osd-journal=td/test-snaptrim-stats/1/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQByZZRpkBHeJxAAMH90vdQl1Awf0JWSbxKE+g== --osd-uuid 58e69894-5ce0-443c-b371-03504011bcc1 2026-02-17T12:56:18.888 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:18.886+0000 7f55a322c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:18.889 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:18.888+0000 7f55a322c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:18.890 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:18.889+0000 7f55a322c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:18.891 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:18.889+0000 7f55a322c780 -1 bdev(0x56155b4d5c00 td/test-snaptrim-stats/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:56:18.891 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:18.889+0000 7f55a322c780 -1 bluestore(td/test-snaptrim-stats/1) _read_fsid unparsable uuid 2026-02-17T12:56:21.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-snaptrim-stats/1/keyring 2026-02-17T12:56:21.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:56:21.011 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:56:21.012 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:56:21.012 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-snaptrim-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:56:21.273 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:56:21.273 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:56:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/1 --osd-journal=td/test-snaptrim-stats/1/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:56:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:56:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:56:21.274 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:56:21.289 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:21.287+0000 7f7290e91780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:21.290 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:21.289+0000 7f7290e91780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:21.291 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:21.290+0000 7f7290e91780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:21.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:56:21.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:56:21.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:56:21.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:56:21.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:56:21.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:21.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:56:21.461 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:56:21.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:21.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:56:21.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:22.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:22.649 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:22.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:56:22.650 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:56:22.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:22.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:56:22.837 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:22.883 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:22.881+0000 7f7290e91780 -1 Falling back to public interface 2026-02-17T12:56:23.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:23.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:23.839 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:56:23.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:56:23.840 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:23.840 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:56:24.027 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:25.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:25.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:25.028 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:56:25.029 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:56:25.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:25.029 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:56:25.214 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:25.824 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:25.823+0000 7f7290e91780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:56:26.216 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:26.216 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:26.216 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:56:26.217 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:56:26.217 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:26.217 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:56:26.417 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:27.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:27.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:27.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:56:27.419 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:56:27.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:27.419 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:56:27.606 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3632715369,v1:127.0.0.1:6811/3632715369] [v2:127.0.0.1:6812/3632715369,v1:127.0.0.1:6813/3632715369] exists,up 58e69894-5ce0-443c-b371-03504011bcc1 2026-02-17T12:56:27.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:56:27.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:56:27.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:56:27.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:118: TEST_snaptrim_stats_multiple_snaps: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T12:56:27.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:120: TEST_snaptrim_stats_multiple_snaps: run_osd td/test-snaptrim-stats 2 --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:56:27.610 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-snaptrim-stats 2026-02-17T12:56:27.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:56:27.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:56:27.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:56:27.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-snaptrim-stats/2 2026-02-17T12:56:27.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 ' 2026-02-17T12:56:27.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:56:27.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:56:27.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:56:27.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-snaptrim-stats/2' 2026-02-17T12:56:27.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-snaptrim-stats/2/journal' 2026-02-17T12:56:27.611 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-snaptrim-stats' 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:56:27.612 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-snaptrim-stats/$name.log' 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-snaptrim-stats/$name.pid' 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-snaptrim-stats/2 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7aff9fc8-b3ea-471f-a94f-7fda046f3b1e 2026-02-17T12:56:27.613 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 7aff9fc8-b3ea-471f-a94f-7fda046f3b1e' 2026-02-17T12:56:27.614 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 7aff9fc8-b3ea-471f-a94f-7fda046f3b1e 2026-02-17T12:56:27.614 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:56:27.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB7ZZRp4b/3JBAA0thyl4+TUXRk8Pc85p5KpA== 2026-02-17T12:56:27.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB7ZZRp4b/3JBAA0thyl4+TUXRk8Pc85p5KpA=="}' 2026-02-17T12:56:27.622 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7aff9fc8-b3ea-471f-a94f-7fda046f3b1e -i td/test-snaptrim-stats/2/new.json 2026-02-17T12:56:27.811 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:56:27.818 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-snaptrim-stats/2/new.json 2026-02-17T12:56:27.819 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/2 --osd-journal=td/test-snaptrim-stats/2/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --mkfs --key AQB7ZZRp4b/3JBAA0thyl4+TUXRk8Pc85p5KpA== --osd-uuid 7aff9fc8-b3ea-471f-a94f-7fda046f3b1e 2026-02-17T12:56:27.837 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:27.836+0000 7fd745220780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:27.838 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:27.837+0000 7fd745220780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:27.839 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:27.838+0000 7fd745220780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:27.840 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:27.838+0000 7fd745220780 -1 bdev(0x564e98449c00 td/test-snaptrim-stats/2/block) open stat got: (1) Operation not permitted 2026-02-17T12:56:27.840 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:27.839+0000 7fd745220780 -1 bluestore(td/test-snaptrim-stats/2) _read_fsid unparsable uuid 2026-02-17T12:56:29.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-snaptrim-stats/2/keyring 2026-02-17T12:56:29.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:56:29.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:56:29.966 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:56:29.967 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-snaptrim-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:56:30.220 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:56:30.220 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:56:30.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=07aa5e63-b595-4ed2-87ff-aec1c2c2257e --auth-supported=none --mon-host=127.0.0.1:7124 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-snaptrim-stats/2 --osd-journal=td/test-snaptrim-stats/2/journal --chdir= --run-dir=td/test-snaptrim-stats '--admin-socket=/tmp/ceph-asok.175758/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-snaptrim-stats/$name.log' '--pid-file=td/test-snaptrim-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off 2026-02-17T12:56:30.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:56:30.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:56:30.221 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:56:30.237 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:30.236+0000 7f6d3281a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:30.239 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:30.237+0000 7f6d3281a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:30.239 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:30.238+0000 7f6d3281a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:56:30.409 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:56:30.409 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:56:30.409 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:56:30.409 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:56:30.409 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:56:30.410 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:30.410 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:56:30.410 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:56:30.411 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:30.411 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:56:30.600 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:31.601 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:31.602 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:31.602 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:56:31.602 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:56:31.603 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:31.603 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:56:31.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:31.821 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:31.819+0000 7f6d3281a780 -1 Falling back to public interface 2026-02-17T12:56:32.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:32.787 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:32.787 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:56:32.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:56:32.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:32.788 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:56:32.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:33.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:33.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:33.980 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:56:33.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:56:33.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:33.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:56:34.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:34.781 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:56:34.780+0000 7f6d3281a780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:56:35.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:35.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:35.169 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:56:35.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:56:35.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:35.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:56:35.360 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:56:36.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:56:36.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:56:36.362 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:56:36.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:56:36.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:56:36.363 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:56:36.549 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/489552661,v1:127.0.0.1:6819/489552661] [v2:127.0.0.1:6820/489552661,v1:127.0.0.1:6821/489552661] exists,up 7aff9fc8-b3ea-471f-a94f-7fda046f3b1e 2026-02-17T12:56:36.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:56:36.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:56:36.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:56:36.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:124: TEST_snaptrim_stats_multiple_snaps: ceph osd set noscrub 2026-02-17T12:56:36.837 INFO:tasks.workunit.client.0.trial155.stderr:noscrub is set 2026-02-17T12:56:36.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:125: TEST_snaptrim_stats_multiple_snaps: ceph osd set nodeep-scrub 2026-02-17T12:56:37.142 INFO:tasks.workunit.client.0.trial155.stderr:nodeep-scrub is set 2026-02-17T12:56:37.152 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:128: TEST_snaptrim_stats_multiple_snaps: create_pool test 8 8 2026-02-17T12:56:37.153 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 8 8 2026-02-17T12:56:37.396 INFO:tasks.workunit.client.0.trial155.stderr:pool 'test' already exists 2026-02-17T12:56:37.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T12:56:38.405 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:129: TEST_snaptrim_stats_multiple_snaps: wait_for_clean 2026-02-17T12:56:38.405 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:56:38.405 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:56:38.405 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:56:38.406 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:56:38.406 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:56:38.407 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:56:38.407 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:56:38.407 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:56:38.407 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:56:38.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:56:38.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:56:38.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:56:38.491 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:56:38.491 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:56:38.491 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:56:38.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:56:38.679 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:56:38.679 INFO:tasks.workunit.client.0.trial155.stderr:2' 2026-02-17T12:56:38.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:56:38.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:56:38.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:56:38.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836487 2026-02-17T12:56:38.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836487 2026-02-17T12:56:38.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T12:56:38.739 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:56:38.739 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:56:38.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672966 2026-02-17T12:56:38.800 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672966 2026-02-17T12:56:38.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-42949672966' 2026-02-17T12:56:38.801 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:56:38.801 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:56:38.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542147 2026-02-17T12:56:38.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542147 2026-02-17T12:56:38.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-42949672966 2-60129542147' 2026-02-17T12:56:38.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:56:38.862 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836487 2026-02-17T12:56:38.862 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:56:38.862 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:56:38.863 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836487 2026-02-17T12:56:38.863 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:56:38.864 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836487 2026-02-17T12:56:38.864 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T12:56:38.865 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836487 2026-02-17T12:56:38.865 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:56:39.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836484 -lt 21474836487 2026-02-17T12:56:39.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:56:40.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:56:40.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:56:40.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T12:56:40.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:56:40.243 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672966 2026-02-17T12:56:40.243 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:56:40.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:56:40.244 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672966 2026-02-17T12:56:40.244 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:56:40.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672966 2026-02-17T12:56:40.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-17T12:56:40.245 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 42949672966 2026-02-17T12:56:40.246 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:56:40.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672966 -lt 42949672966 2026-02-17T12:56:40.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:56:40.437 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542147 2026-02-17T12:56:40.437 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:56:40.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:56:40.438 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542147 2026-02-17T12:56:40.438 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:56:40.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542147 2026-02-17T12:56:40.439 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T12:56:40.440 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 60129542147 2026-02-17T12:56:40.440 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:56:40.627 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T12:56:40.628 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:56:40.628 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:56:40.628 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:56:40.879 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 == 0 2026-02-17T12:56:40.879 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:56:40.880 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:56:40.880 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:56:40.880 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:56:40.880 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:56:40.880 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:56:40.880 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:56:41.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=8 2026-02-17T12:56:41.065 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:56:41.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:56:41.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:56:41.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 8 = 8 2026-02-17T12:56:41.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:56:41.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:56:41.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:130: TEST_snaptrim_stats_multiple_snaps: ceph osd dump 2026-02-17T12:56:41.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:130: TEST_snaptrim_stats_multiple_snaps: grep '^pool.*['\'']test['\'']' 2026-02-17T12:56:41.327 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:130: TEST_snaptrim_stats_multiple_snaps: awk '{ print $2 }' 2026-02-17T12:56:41.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:130: TEST_snaptrim_stats_multiple_snaps: poolid=1 2026-02-17T12:56:41.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:133: TEST_snaptrim_stats_multiple_snaps: local TESTDATA=testdata.0 2026-02-17T12:56:41.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:134: TEST_snaptrim_stats_multiple_snaps: dd if=/dev/urandom of=testdata.0 bs=4096 count=1 2026-02-17T12:56:41.516 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records in 2026-02-17T12:56:41.516 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records out 2026-02-17T12:56:41.516 INFO:tasks.workunit.client.0.trial155.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 4.3882e-05 s, 93.3 MB/s 2026-02-17T12:56:41.516 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: seq 1 10 2026-02-17T12:56:41.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.517 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj1 testdata.0 2026-02-17T12:56:41.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.537 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj2 testdata.0 2026-02-17T12:56:41.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj3 testdata.0 2026-02-17T12:56:41.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj4 testdata.0 2026-02-17T12:56:41.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj5 testdata.0 2026-02-17T12:56:41.607 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.607 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj6 testdata.0 2026-02-17T12:56:41.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj7 testdata.0 2026-02-17T12:56:41.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj8 testdata.0 2026-02-17T12:56:41.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.658 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj9 testdata.0 2026-02-17T12:56:41.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:135: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.676 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:137: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj10 testdata.0 2026-02-17T12:56:41.693 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:139: TEST_snaptrim_stats_multiple_snaps: rm -f testdata.0 2026-02-17T12:56:41.694 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:142: TEST_snaptrim_stats_multiple_snaps: NUMSNAPS=2 2026-02-17T12:56:41.694 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:143: TEST_snaptrim_stats_multiple_snaps: seq 1 2 2026-02-17T12:56:41.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:143: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $NUMSNAPS` 2026-02-17T12:56:41.695 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:145: TEST_snaptrim_stats_multiple_snaps: rados -p test mksnap snap1 2026-02-17T12:56:41.763 INFO:tasks.workunit.client.0.trial155.stdout:created pool test snap snap1 2026-02-17T12:56:41.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:146: TEST_snaptrim_stats_multiple_snaps: TESTDATA=testdata.1 2026-02-17T12:56:41.765 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:147: TEST_snaptrim_stats_multiple_snaps: dd if=/dev/urandom of=testdata.1 bs=4096 count=1 2026-02-17T12:56:41.766 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records in 2026-02-17T12:56:41.766 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records out 2026-02-17T12:56:41.766 INFO:tasks.workunit.client.0.trial155.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 5.5253e-05 s, 74.1 MB/s 2026-02-17T12:56:41.767 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: seq 1 10 2026-02-17T12:56:41.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj1 testdata.1 2026-02-17T12:56:41.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.786 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj2 testdata.1 2026-02-17T12:56:41.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj3 testdata.1 2026-02-17T12:56:41.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.821 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj4 testdata.1 2026-02-17T12:56:41.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj5 testdata.1 2026-02-17T12:56:41.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj6 testdata.1 2026-02-17T12:56:41.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj7 testdata.1 2026-02-17T12:56:41.894 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.894 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj8 testdata.1 2026-02-17T12:56:41.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj9 testdata.1 2026-02-17T12:56:41.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:41.930 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj10 testdata.1 2026-02-17T12:56:41.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:152: TEST_snaptrim_stats_multiple_snaps: rm -f testdata.1 2026-02-17T12:56:41.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:143: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $NUMSNAPS` 2026-02-17T12:56:41.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:145: TEST_snaptrim_stats_multiple_snaps: rados -p test mksnap snap2 2026-02-17T12:56:42.015 INFO:tasks.workunit.client.0.trial155.stdout:created pool test snap snap2 2026-02-17T12:56:42.017 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:146: TEST_snaptrim_stats_multiple_snaps: TESTDATA=testdata.2 2026-02-17T12:56:42.017 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:147: TEST_snaptrim_stats_multiple_snaps: dd if=/dev/urandom of=testdata.2 bs=4096 count=1 2026-02-17T12:56:42.018 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records in 2026-02-17T12:56:42.018 INFO:tasks.workunit.client.0.trial155.stderr:1+0 records out 2026-02-17T12:56:42.018 INFO:tasks.workunit.client.0.trial155.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 4.5285e-05 s, 90.4 MB/s 2026-02-17T12:56:42.018 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: seq 1 10 2026-02-17T12:56:42.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:42.019 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj1 testdata.2 2026-02-17T12:56:42.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:42.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj2 testdata.2 2026-02-17T12:56:42.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:42.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj3 testdata.2 2026-02-17T12:56:42.074 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:42.074 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj4 testdata.2 2026-02-17T12:56:42.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:42.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj5 testdata.2 2026-02-17T12:56:42.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:42.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj6 testdata.2 2026-02-17T12:56:42.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:42.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj7 testdata.2 2026-02-17T12:56:42.143 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:42.143 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj8 testdata.2 2026-02-17T12:56:42.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:42.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj9 testdata.2 2026-02-17T12:56:42.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:148: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $objects` 2026-02-17T12:56:42.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:150: TEST_snaptrim_stats_multiple_snaps: rados -p test put obj10 testdata.2 2026-02-17T12:56:42.195 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:152: TEST_snaptrim_stats_multiple_snaps: rm -f testdata.2 2026-02-17T12:56:42.196 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:156: TEST_snaptrim_stats_multiple_snaps: local total_objects_trimmed=0 2026-02-17T12:56:42.196 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:157: TEST_snaptrim_stats_multiple_snaps: seq 1 2 2026-02-17T12:56:42.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:157: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $NUMSNAPS` 2026-02-17T12:56:42.197 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:159: TEST_snaptrim_stats_multiple_snaps: rados -p test rmsnap snap1 2026-02-17T12:56:42.265 INFO:tasks.workunit.client.0.trial155.stdout:removed pool test snap snap1 2026-02-17T12:56:42.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:162: TEST_snaptrim_stats_multiple_snaps: wait_for_clean 2026-02-17T12:56:42.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:56:42.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:56:42.268 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:56:42.269 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:56:42.269 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:56:42.269 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:56:42.269 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:56:42.269 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:56:42.269 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:56:42.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:56:42.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:56:42.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:56:42.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:56:42.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:56:42.351 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:56:42.538 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:56:42.539 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:56:42.539 INFO:tasks.workunit.client.0.trial155.stderr:2' 2026-02-17T12:56:42.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:56:42.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:56:42.539 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:56:42.599 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836489 2026-02-17T12:56:42.599 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836489 2026-02-17T12:56:42.599 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489' 2026-02-17T12:56:42.599 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:56:42.600 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:56:42.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672969 2026-02-17T12:56:42.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672969 2026-02-17T12:56:42.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489 1-42949672969' 2026-02-17T12:56:42.660 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:56:42.660 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:56:42.720 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542150 2026-02-17T12:56:42.721 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542150 2026-02-17T12:56:42.721 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489 1-42949672969 2-60129542150' 2026-02-17T12:56:42.721 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:56:42.721 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836489 2026-02-17T12:56:42.721 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:56:42.722 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:56:42.722 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836489 2026-02-17T12:56:42.722 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:56:42.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836489 2026-02-17T12:56:42.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2026-02-17T12:56:42.724 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836489 2026-02-17T12:56:42.724 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:56:42.914 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836489 2026-02-17T12:56:42.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:56:43.915 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:56:43.916 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:56:44.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836489 -lt 21474836489 2026-02-17T12:56:44.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:56:44.108 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672969 2026-02-17T12:56:44.109 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:56:44.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:56:44.109 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672969 2026-02-17T12:56:44.110 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:56:44.111 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672969 2026-02-17T12:56:44.111 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2026-02-17T12:56:44.111 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 42949672969 2026-02-17T12:56:44.111 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:56:44.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672969 -lt 42949672969 2026-02-17T12:56:44.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:56:44.300 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542150 2026-02-17T12:56:44.300 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:56:44.301 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:56:44.301 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542150 2026-02-17T12:56:44.302 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:56:44.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542150 2026-02-17T12:56:44.303 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T12:56:44.303 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 60129542150 2026-02-17T12:56:44.303 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:56:44.494 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T12:56:44.495 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:56:44.495 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:56:44.495 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:56:44.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 == 0 2026-02-17T12:56:44.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:56:44.750 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:56:44.751 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:56:44.751 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:56:44.751 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:56:44.751 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:56:44.751 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:56:44.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=8 2026-02-17T12:56:44.937 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:56:44.937 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:56:44.937 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:56:45.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 8 = 8 2026-02-17T12:56:45.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:56:45.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:56:45.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:163: TEST_snaptrim_stats_multiple_snaps: sleep 10 2026-02-17T12:56:55.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:164: TEST_snaptrim_stats_multiple_snaps: local objects_trimmed=0 2026-02-17T12:56:55.190 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:165: TEST_snaptrim_stats_multiple_snaps: local snaptrim_duration_total=0.0 2026-02-17T12:56:55.191 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: expr 8 - 1 2026-02-17T12:56:55.192 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: seq 0 7 2026-02-17T12:56:55.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:55.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.0 2026-02-17T12:56:55.195 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.0 query 2026-02-17T12:56:55.195 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:56:55.258 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 0 + 2 2026-02-17T12:56:55.259 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=2 2026-02-17T12:56:55.259 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:56:55.260 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.0 query 2026-02-17T12:56:55.260 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:56:55.325 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo 0.0 + 0.0015175010000000001 2026-02-17T12:56:55.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.0015175010000000001 2026-02-17T12:56:55.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:55.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.1 2026-02-17T12:56:55.326 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.1 query 2026-02-17T12:56:55.326 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:56:55.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 2 + 2 2026-02-17T12:56:55.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=4 2026-02-17T12:56:55.391 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:56:55.392 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.1 query 2026-02-17T12:56:55.392 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:56:55.455 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .0015175010000000001 + 0.0017538930000000001 2026-02-17T12:56:55.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.0032713940000000002 2026-02-17T12:56:55.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:55.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.2 2026-02-17T12:56:55.457 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.2 query 2026-02-17T12:56:55.457 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:56:55.523 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 4 + 0 2026-02-17T12:56:55.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=4 2026-02-17T12:56:55.524 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:56:55.525 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.2 query 2026-02-17T12:56:55.525 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:56:55.587 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .0032713940000000002 + 0.00025649100000000002 2026-02-17T12:56:55.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.00352788500000000022 2026-02-17T12:56:55.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:55.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.3 2026-02-17T12:56:55.589 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.3 query 2026-02-17T12:56:55.589 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:56:55.653 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 4 + 2 2026-02-17T12:56:55.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=6 2026-02-17T12:56:55.654 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:56:55.655 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.3 query 2026-02-17T12:56:55.655 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:56:55.719 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .00352788500000000022 + 0.0030813289999999998 2026-02-17T12:56:55.719 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.00660921400000000002 2026-02-17T12:56:55.720 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:55.720 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.4 2026-02-17T12:56:55.720 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.4 query 2026-02-17T12:56:55.720 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:56:55.783 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 6 + 1 2026-02-17T12:56:55.784 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=7 2026-02-17T12:56:55.785 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:56:55.785 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.4 query 2026-02-17T12:56:55.786 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:56:55.848 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .00660921400000000002 + 0.0012327480000000001 2026-02-17T12:56:55.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.00784196200000000012 2026-02-17T12:56:55.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:55.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.5 2026-02-17T12:56:55.850 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.5 query 2026-02-17T12:56:55.850 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:56:55.912 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 7 + 1 2026-02-17T12:56:55.913 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=8 2026-02-17T12:56:55.914 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:56:55.915 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.5 query 2026-02-17T12:56:55.915 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:56:55.978 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .00784196200000000012 + 0.001298371 2026-02-17T12:56:55.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.00914033300000000012 2026-02-17T12:56:55.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:55.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.6 2026-02-17T12:56:55.979 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.6 query 2026-02-17T12:56:55.980 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:56:56.045 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 8 + 0 2026-02-17T12:56:56.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=8 2026-02-17T12:56:56.047 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:56:56.048 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.6 query 2026-02-17T12:56:56.048 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:56:56.112 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .00914033300000000012 + 0.0014029470000000001 2026-02-17T12:56:56.113 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.01054328000000000022 2026-02-17T12:56:56.113 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:56:56.113 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.7 2026-02-17T12:56:56.114 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.7 query 2026-02-17T12:56:56.114 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:56:56.179 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 8 + 2 2026-02-17T12:56:56.180 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=10 2026-02-17T12:56:56.181 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:56:56.182 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.7 query 2026-02-17T12:56:56.182 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:56:56.245 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .01054328000000000022 + 0.002972274 2026-02-17T12:56:56.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.01351555400000000022 2026-02-17T12:56:56.246 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:174: TEST_snaptrim_stats_multiple_snaps: test 10 -eq 10 2026-02-17T12:56:56.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:175: TEST_snaptrim_stats_multiple_snaps: echo '.01351555400000000022 > 0.0' 2026-02-17T12:56:56.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:175: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:56:56.247 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:56:56.248 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:176: TEST_snaptrim_stats_multiple_snaps: expr 0 + 10 2026-02-17T12:56:56.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:176: TEST_snaptrim_stats_multiple_snaps: total_objects_trimmed=10 2026-02-17T12:56:56.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:157: TEST_snaptrim_stats_multiple_snaps: for i in `seq 1 $NUMSNAPS` 2026-02-17T12:56:56.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:159: TEST_snaptrim_stats_multiple_snaps: rados -p test rmsnap snap2 2026-02-17T12:56:56.316 INFO:tasks.workunit.client.0.trial155.stdout:removed pool test snap snap2 2026-02-17T12:56:56.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:162: TEST_snaptrim_stats_multiple_snaps: wait_for_clean 2026-02-17T12:56:56.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T12:56:56.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T12:56:56.319 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T12:56:56.319 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T12:56:56.320 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T12:56:56.320 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T12:56:56.320 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T12:56:56.320 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T12:56:56.320 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T12:56:56.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T12:56:56.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T12:56:56.404 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T12:56:56.404 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T12:56:56.404 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T12:56:56.404 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T12:56:56.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T12:56:56.591 INFO:tasks.workunit.client.0.trial155.stderr:1 2026-02-17T12:56:56.591 INFO:tasks.workunit.client.0.trial155.stderr:2' 2026-02-17T12:56:56.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T12:56:56.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:56:56.592 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T12:56:56.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836494 2026-02-17T12:56:56.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836494 2026-02-17T12:56:56.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836494' 2026-02-17T12:56:56.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:56:56.654 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T12:56:56.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672973 2026-02-17T12:56:56.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672973 2026-02-17T12:56:56.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836494 1-42949672973' 2026-02-17T12:56:56.716 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T12:56:56.716 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T12:56:56.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542155 2026-02-17T12:56:56.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542155 2026-02-17T12:56:56.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836494 1-42949672973 2-60129542155' 2026-02-17T12:56:56.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:56:56.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836494 2026-02-17T12:56:56.779 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:56:56.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T12:56:56.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836494 2026-02-17T12:56:56.780 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:56:56.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836494 2026-02-17T12:56:56.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-17T12:56:56.781 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.0 seq 21474836494 2026-02-17T12:56:56.781 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:56:56.971 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836492 -lt 21474836494 2026-02-17T12:56:56.971 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T12:56:57.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T12:56:57.972 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T12:56:58.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-17T12:56:58.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:56:58.161 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672973 2026-02-17T12:56:58.161 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:56:58.162 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T12:56:58.163 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672973 2026-02-17T12:56:58.163 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:56:58.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672973 2026-02-17T12:56:58.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672973' 2026-02-17T12:56:58.164 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.1 seq 42949672973 2026-02-17T12:56:58.165 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T12:56:58.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672974 -lt 42949672973 2026-02-17T12:56:58.353 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T12:56:58.354 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542155 2026-02-17T12:56:58.354 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T12:56:58.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T12:56:58.355 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542155 2026-02-17T12:56:58.355 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T12:56:58.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542155 2026-02-17T12:56:58.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-17T12:56:58.357 INFO:tasks.workunit.client.0.trial155.stdout:waiting osd.2 seq 60129542155 2026-02-17T12:56:58.357 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T12:56:58.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542155 -lt 60129542155 2026-02-17T12:56:58.552 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T12:56:58.552 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:56:58.552 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:56:58.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 == 0 2026-02-17T12:56:58.809 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T12:56:58.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T12:56:58.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T12:56:58.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T12:56:58.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T12:56:58.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T12:56:58.810 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T12:56:58.994 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=8 2026-02-17T12:56:58.994 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T12:56:58.994 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T12:56:58.995 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T12:56:59.247 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 8 = 8 2026-02-17T12:56:59.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T12:56:59.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T12:56:59.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:163: TEST_snaptrim_stats_multiple_snaps: sleep 10 2026-02-17T12:57:09.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:164: TEST_snaptrim_stats_multiple_snaps: local objects_trimmed=0 2026-02-17T12:57:09.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:165: TEST_snaptrim_stats_multiple_snaps: local snaptrim_duration_total=0.0 2026-02-17T12:57:09.249 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: expr 8 - 1 2026-02-17T12:57:09.250 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: seq 0 7 2026-02-17T12:57:09.251 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:57:09.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.0 2026-02-17T12:57:09.253 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.0 query 2026-02-17T12:57:09.253 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:57:09.320 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 0 + 2 2026-02-17T12:57:09.321 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=2 2026-02-17T12:57:09.322 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:57:09.322 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.0 query 2026-02-17T12:57:09.322 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:57:09.384 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo 0.0 + 0.001689914 2026-02-17T12:57:09.385 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.001689914 2026-02-17T12:57:09.385 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:57:09.385 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.1 2026-02-17T12:57:09.386 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.1 query 2026-02-17T12:57:09.386 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:57:09.451 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 2 + 2 2026-02-17T12:57:09.452 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=4 2026-02-17T12:57:09.453 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:57:09.453 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.1 query 2026-02-17T12:57:09.453 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:57:09.518 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .001689914 + 0.0017694220000000001 2026-02-17T12:57:09.519 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.0034593360000000001 2026-02-17T12:57:09.519 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:57:09.519 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.2 2026-02-17T12:57:09.520 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.2 query 2026-02-17T12:57:09.520 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:57:09.586 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 4 + 0 2026-02-17T12:57:09.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=4 2026-02-17T12:57:09.587 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:57:09.588 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.2 query 2026-02-17T12:57:09.588 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:57:09.650 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .0034593360000000001 + 0.00020835999999999999 2026-02-17T12:57:09.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.00366769600000000009 2026-02-17T12:57:09.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:57:09.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.3 2026-02-17T12:57:09.652 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.3 query 2026-02-17T12:57:09.652 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:57:09.717 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 4 + 2 2026-02-17T12:57:09.718 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=6 2026-02-17T12:57:09.718 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:57:09.719 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.3 query 2026-02-17T12:57:09.719 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:57:09.782 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .00366769600000000009 + 0.0016481060000000001 2026-02-17T12:57:09.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.00531580200000000019 2026-02-17T12:57:09.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:57:09.783 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.4 2026-02-17T12:57:09.784 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.4 query 2026-02-17T12:57:09.784 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:57:09.847 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 6 + 1 2026-02-17T12:57:09.848 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=7 2026-02-17T12:57:09.849 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:57:09.849 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.4 query 2026-02-17T12:57:09.850 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:57:09.911 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .00531580200000000019 + 0.002854915 2026-02-17T12:57:09.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.00817071700000000019 2026-02-17T12:57:09.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:57:09.912 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.5 2026-02-17T12:57:09.913 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.5 query 2026-02-17T12:57:09.913 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:57:09.977 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 7 + 1 2026-02-17T12:57:09.978 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=8 2026-02-17T12:57:09.979 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:57:09.979 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.5 query 2026-02-17T12:57:09.979 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:57:10.042 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .00817071700000000019 + 0.0013642839999999999 2026-02-17T12:57:10.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.00953500100000000009 2026-02-17T12:57:10.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:57:10.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.6 2026-02-17T12:57:10.043 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.6 query 2026-02-17T12:57:10.043 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:57:10.107 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 8 + 0 2026-02-17T12:57:10.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=8 2026-02-17T12:57:10.108 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:57:10.109 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.6 query 2026-02-17T12:57:10.109 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:57:10.174 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .00953500100000000009 + 0.0018484910000000001 2026-02-17T12:57:10.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.01138349200000000019 2026-02-17T12:57:10.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:166: TEST_snaptrim_stats_multiple_snaps: for i in $(seq 0 $(expr $PGNUM - 1)) 2026-02-17T12:57:10.175 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:168: TEST_snaptrim_stats_multiple_snaps: local pgid=1.7 2026-02-17T12:57:10.175 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.7 query 2026-02-17T12:57:10.176 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.objects_trimmed 2026-02-17T12:57:10.242 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: expr 8 + 2 2026-02-17T12:57:10.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:170: TEST_snaptrim_stats_multiple_snaps: objects_trimmed=10 2026-02-17T12:57:10.244 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:57:10.244 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: ceph pg 1.7 query 2026-02-17T12:57:10.245 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: jq .info.stats.snaptrim_duration 2026-02-17T12:57:10.308 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: echo .01138349200000000019 + 0.0033046870000000002 2026-02-17T12:57:10.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:172: TEST_snaptrim_stats_multiple_snaps: snaptrim_duration_total=.01468817900000000039 2026-02-17T12:57:10.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:174: TEST_snaptrim_stats_multiple_snaps: test 10 -eq 10 2026-02-17T12:57:10.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:175: TEST_snaptrim_stats_multiple_snaps: echo '.01468817900000000039 > 0.0' 2026-02-17T12:57:10.309 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:175: TEST_snaptrim_stats_multiple_snaps: bc 2026-02-17T12:57:10.309 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:57:10.310 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:176: TEST_snaptrim_stats_multiple_snaps: expr 10 + 10 2026-02-17T12:57:10.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:176: TEST_snaptrim_stats_multiple_snaps: total_objects_trimmed=20 2026-02-17T12:57:10.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:179: TEST_snaptrim_stats_multiple_snaps: test 20 -eq 20 2026-02-17T12:57:10.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:181: TEST_snaptrim_stats_multiple_snaps: teardown td/test-snaptrim-stats 2026-02-17T12:57:10.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-snaptrim-stats 2026-02-17T12:57:10.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:57:10.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-17T12:57:10.312 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:57:10.312 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:57:10.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:57:10.312 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:57:10.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:57:10.418 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:57:10.419 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:57:10.420 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:57:10.420 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:57:10.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:57:10.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:57:10.422 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:57:10.423 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:57:10.423 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:57:10.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:57:10.424 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:57:10.424 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:57:10.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:57:10.425 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-snaptrim-stats 2026-02-17T12:57:10.456 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:57:10.456 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.456 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:57:10.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.175758 2026-02-17T12:57:10.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:57:10.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:57:10.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh:34: run: teardown td/test-snaptrim-stats 2026-02-17T12:57:10.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-snaptrim-stats 2026-02-17T12:57:10.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:57:10.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-17T12:57:10.458 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:57:10.458 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:57:10.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:57:10.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:57:10.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:57:10.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:57:10.459 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:57:10.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:57:10.460 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:57:10.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:57:10.461 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:57:10.461 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:57:10.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:57:10.462 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:57:10.463 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:57:10.463 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:57:10.463 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:57:10.464 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:57:10.464 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-snaptrim-stats 2026-02-17T12:57:10.465 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:57:10.465 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.465 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:57:10.466 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.175758 2026-02-17T12:57:10.467 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:57:10.467 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:57:10.467 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T12:57:10.467 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/test-snaptrim-stats 0 2026-02-17T12:57:10.467 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-snaptrim-stats 2026-02-17T12:57:10.467 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T12:57:10.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-snaptrim-stats KILL 2026-02-17T12:57:10.468 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:57:10.468 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:57:10.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:57:10.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:57:10.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:57:10.468 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:57:10.469 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:57:10.469 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:57:10.469 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:57:10.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:57:10.470 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:57:10.471 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:57:10.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:57:10.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:57:10.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:57:10.472 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:57:10.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:57:10.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T12:57:10.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-snaptrim-stats 2026-02-17T12:57:10.474 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:57:10.475 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.475 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.175758 2026-02-17T12:57:10.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.175758 2026-02-17T12:57:10.475 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:57:10.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:57:10.476 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T12:57:10.477 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T12:57:10.477 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T12:57:10.502 INFO:tasks.workunit:Running workunit misc/ver-health.sh... 2026-02-17T12:57:10.502 DEBUG:teuthology.orchestra.run.trial155:workunit test misc/ver-health.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c96dfb3f50b3d02598a82af7104764bfdcd3919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh 2026-02-17T12:57:10.564 INFO:tasks.workunit.client.0.trial155.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T12:57:10.568 INFO:tasks.workunit.client.0.trial155.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T12:57:10.568 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:57:10.568 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T12:57:10.568 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/ver-health 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:20: run: local dir=td/ver-health 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:21: run: shift 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:23: run: export CEPH_MON_A=127.0.0.1:7165 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:23: run: CEPH_MON_A=127.0.0.1:7165 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:24: run: export CEPH_MON_B=127.0.0.1:7166 2026-02-17T12:57:10.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:24: run: CEPH_MON_B=127.0.0.1:7166 2026-02-17T12:57:10.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:25: run: export CEPH_ARGS 2026-02-17T12:57:10.570 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:26: run: uuidgen 2026-02-17T12:57:10.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:26: run: CEPH_ARGS+='--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none ' 2026-02-17T12:57:10.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:27: run: CEPH_ARGS+='--mon-host= ' 2026-02-17T12:57:10.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:28: run: CEPH_ARGS+='--mon_health_to_clog_tick_interval=1.0 ' 2026-02-17T12:57:10.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:29: run: export 'ORIG_CEPH_ARGS=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 ' 2026-02-17T12:57:10.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:29: run: ORIG_CEPH_ARGS='--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 ' 2026-02-17T12:57:10.572 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:31: run: set 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:31: run: local 'funcs=TEST_check_version_health_1 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr:TEST_check_version_health_2 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr:TEST_check_version_health_3' 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:32: run: for func in $funcs 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:33: run: setup td/ver-health 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ver-health 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ver-health 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ver-health 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ver-health KILL 2026-02-17T12:57:10.573 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:57:10.574 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:57:10.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:57:10.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:57:10.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:57:10.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:57:10.575 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:57:10.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:57:10.575 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:57:10.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:57:10.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:57:10.575 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:57:10.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:57:10.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:57:10.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:57:10.577 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:57:10.577 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:57:10.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:57:10.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ver-health 2026-02-17T12:57:10.579 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:57:10.579 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.579 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:10.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.189587 2026-02-17T12:57:10.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:57:10.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:57:10.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ver-health 2026-02-17T12:57:10.581 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:57:10.581 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.581 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:10.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.189587 2026-02-17T12:57:10.582 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:57:10.584 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T12:57:10.584 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T12:57:10.584 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:57:10.584 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-17T12:57:10.584 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:34: run: TEST_check_version_health_1 td/ver-health 2026-02-17T12:57:10.585 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:68: TEST_check_version_health_1: local dir=td/ver-health 2026-02-17T12:57:10.585 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:71: TEST_check_version_health_1: CEPH_ARGS='--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:57:10.585 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:73: TEST_check_version_health_1: setup td/ver-health 2026-02-17T12:57:10.585 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ver-health 2026-02-17T12:57:10.585 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ver-health 2026-02-17T12:57:10.585 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ver-health 2026-02-17T12:57:10.585 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:57:10.585 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ver-health KILL 2026-02-17T12:57:10.585 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:57:10.585 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:57:10.585 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:57:10.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:57:10.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:57:10.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:57:10.587 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:57:10.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:57:10.587 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:57:10.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:57:10.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:57:10.588 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:57:10.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:57:10.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:57:10.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:57:10.588 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:57:10.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:57:10.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:57:10.590 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ver-health 2026-02-17T12:57:10.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:57:10.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.591 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:10.591 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.189587 2026-02-17T12:57:10.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:57:10.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:57:10.592 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ver-health 2026-02-17T12:57:10.593 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:57:10.593 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.593 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:10.593 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.189587 2026-02-17T12:57:10.594 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:57:10.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:57:10.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:57:10.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-17T12:57:10.595 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:76: TEST_check_version_health_1: run_mon td/ver-health a --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-17T12:57:10.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ver-health 2026-02-17T12:57:10.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:57:10.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:57:10.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:57:10.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ver-health/a 2026-02-17T12:57:10.596 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ver-health/a --run-dir=td/ver-health --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-17T12:57:10.615 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:57:10.616 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:57:10.616 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:57:10.616 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:57:10.616 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.616 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:10.616 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:10.616 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/a '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-17T12:57:10.642 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:57:10.644 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:57:10.644 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:57:10.644 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:57:10.644 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:57:10.644 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:57:10.645 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:57:10.645 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:57:10.645 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:57:10.645 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:57:10.645 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.645 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:10.645 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.a.asok 2026-02-17T12:57:10.646 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:57:10.646 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.a.asok config get fsid 2026-02-17T12:57:10.689 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:57:10.689 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:57:10.689 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:57:10.689 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:57:10.690 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:57:10.691 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:57:10.691 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:57:10.691 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:57:10.691 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:57:10.691 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.691 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:10.691 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.a.asok 2026-02-17T12:57:10.691 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:57:10.692 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.a.asok config get mon_host 2026-02-17T12:57:10.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:77: TEST_check_version_health_1: run_mon td/ver-health b --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-17T12:57:10.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ver-health 2026-02-17T12:57:10.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:57:10.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2026-02-17T12:57:10.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:57:10.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ver-health/b 2026-02-17T12:57:10.735 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ver-health/b --run-dir=td/ver-health --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-17T12:57:10.754 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:57:10.754 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:57:10.754 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:57:10.754 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:57:10.755 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.755 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:10.755 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:10.755 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/b '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-17T12:57:10.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:57:10.782 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b fsid 2026-02-17T12:57:10.782 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:57:10.782 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:57:10.782 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:57:10.782 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:57:10.783 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:57:10.783 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:57:10.784 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:57:10.784 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:57:10.784 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.784 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:10.784 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.b.asok 2026-02-17T12:57:10.784 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:57:10.784 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.b.asok config get fsid 2026-02-17T12:57:10.827 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b mon_host 2026-02-17T12:57:10.827 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:57:10.828 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:57:10.828 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:57:10.828 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:57:10.829 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:57:10.829 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:57:10.829 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:57:10.829 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:57:10.829 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.829 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:10.829 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.b.asok 2026-02-17T12:57:10.830 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:57:10.830 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.b.asok config get mon_host 2026-02-17T12:57:10.875 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:78: TEST_check_version_health_1: run_osd td/ver-health 0 2026-02-17T12:57:10.875 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ver-health 2026-02-17T12:57:10.875 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:57:10.875 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:57:10.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:57:10.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ver-health/0 2026-02-17T12:57:10.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:57:10.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:57:10.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:57:10.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:57:10.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-17T12:57:10.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-17T12:57:10.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:57:10.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:57:10.876 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:57:10.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:57:10.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:57:10.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:57:10.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:57:10.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:57:10.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:57:10.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:57:10.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:57:10.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ver-health/0 2026-02-17T12:57:10.878 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:57:10.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=69841df6-19d4-49cd-8abb-7a701352552b 2026-02-17T12:57:10.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 69841df6-19d4-49cd-8abb-7a701352552b' 2026-02-17T12:57:10.879 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 69841df6-19d4-49cd-8abb-7a701352552b 2026-02-17T12:57:10.879 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:57:10.886 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCmZZRp59bCNBAAg6HZmxGyG5cF/oO5CwiY0Q== 2026-02-17T12:57:10.886 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCmZZRp59bCNBAAg6HZmxGyG5cF/oO5CwiY0Q=="}' 2026-02-17T12:57:10.886 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 69841df6-19d4-49cd-8abb-7a701352552b -i td/ver-health/0/new.json 2026-02-17T12:57:16.990 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:57:16.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ver-health/0/new.json 2026-02-17T12:57:16.997 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCmZZRp59bCNBAAg6HZmxGyG5cF/oO5CwiY0Q== --osd-uuid 69841df6-19d4-49cd-8abb-7a701352552b 2026-02-17T12:57:17.014 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:17.013+0000 7f1d58e0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:17.015 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:17.014+0000 7f1d58e0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:17.016 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:17.015+0000 7f1d58e0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:17.017 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:17.015+0000 7f1d58e0d780 -1 bdev(0x55e6c119bc00 td/ver-health/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:57:17.017 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:17.015+0000 7f1d58e0d780 -1 bluestore(td/ver-health/0) _read_fsid unparsable uuid 2026-02-17T12:57:19.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ver-health/0/keyring 2026-02-17T12:57:19.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:57:19.140 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:57:19.140 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:57:19.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ver-health/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:57:19.244 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:57:19.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:57:19.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:57:19.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:57:19.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:57:19.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:57:19.260 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:19.258+0000 7f60a470c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:19.261 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:19.260+0000 7f60a470c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:19.262 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:19.261+0000 7f60a470c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:19.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:57:19.340 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:57:19.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:57:19.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:57:19.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:57:19.341 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:19.341 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:57:19.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:57:19.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:19.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:57:19.435 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:20.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:20.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:20.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:57:20.437 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:57:20.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:20.438 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:57:20.534 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:20.836 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:20.834+0000 7f60a470c780 -1 Falling back to public interface 2026-02-17T12:57:21.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:21.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:21.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:57:21.536 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:57:21.536 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:21.537 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:57:21.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:22.633 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:22.634 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:22.634 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:57:22.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:57:22.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:22.635 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:57:22.731 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:23.541 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:23.540+0000 7f60a470c780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:57:23.732 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:23.733 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:23.733 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:57:23.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:57:23.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:23.734 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:57:23.830 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:24.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:24.831 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:24.832 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:57:24.832 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:57:24.833 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:24.833 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:57:24.932 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/512811675,v1:127.0.0.1:6801/512811675] [v2:127.0.0.1:6802/512811675,v1:127.0.0.1:6803/512811675] exists,up 69841df6-19d4-49cd-8abb-7a701352552b 2026-02-17T12:57:24.935 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:57:24.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:57:24.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:57:24.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:79: TEST_check_version_health_1: run_osd td/ver-health 1 2026-02-17T12:57:24.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ver-health 2026-02-17T12:57:24.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:57:24.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:57:24.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:57:24.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ver-health/1 2026-02-17T12:57:24.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:57:24.936 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ver-health/1' 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ver-health/1/journal' 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:24.937 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:57:24.938 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:57:24.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ver-health/1 2026-02-17T12:57:24.939 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:57:24.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7efaf352-6197-49ba-8a33-1851edf4c342 2026-02-17T12:57:24.939 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 7efaf352-6197-49ba-8a33-1851edf4c342 2026-02-17T12:57:24.939 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 7efaf352-6197-49ba-8a33-1851edf4c342' 2026-02-17T12:57:24.940 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:57:24.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC0ZZRp1kZfOBAA1CKgfeRE/rTpXu07pxksFA== 2026-02-17T12:57:24.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC0ZZRp1kZfOBAA1CKgfeRE/rTpXu07pxksFA=="}' 2026-02-17T12:57:24.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7efaf352-6197-49ba-8a33-1851edf4c342 -i td/ver-health/1/new.json 2026-02-17T12:57:25.049 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:57:25.054 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ver-health/1/new.json 2026-02-17T12:57:25.055 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC0ZZRp1kZfOBAA1CKgfeRE/rTpXu07pxksFA== --osd-uuid 7efaf352-6197-49ba-8a33-1851edf4c342 2026-02-17T12:57:25.073 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:25.072+0000 7f6d27337780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:25.074 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:25.073+0000 7f6d27337780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:25.075 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:25.074+0000 7f6d27337780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:25.076 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:25.074+0000 7f6d27337780 -1 bdev(0x5591fbdd5c00 td/ver-health/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:57:25.076 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:25.074+0000 7f6d27337780 -1 bluestore(td/ver-health/1) _read_fsid unparsable uuid 2026-02-17T12:57:27.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ver-health/1/keyring 2026-02-17T12:57:27.192 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:57:27.193 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:57:27.194 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:57:27.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ver-health/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:57:27.294 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:57:27.294 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:57:27.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:57:27.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:57:27.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:57:27.295 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:57:27.310 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:27.309+0000 7fa5c2699780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:27.312 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:27.310+0000 7fa5c2699780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:27.313 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:27.311+0000 7fa5c2699780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:27.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:57:27.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:57:27.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:57:27.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:57:27.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:57:27.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:27.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:57:27.392 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:57:27.393 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:27.393 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:57:27.487 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:28.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:28.489 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:28.489 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:57:28.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:57:28.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:28.490 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:57:28.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:28.657 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:28.655+0000 7fa5c2699780 -1 Falling back to public interface 2026-02-17T12:57:29.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:29.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:29.588 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:57:29.588 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:57:29.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:29.589 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:57:29.684 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:30.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:30.685 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:30.686 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:57:30.686 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:57:30.686 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:30.686 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:57:30.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:31.353 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:31.351+0000 7fa5c2699780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:57:31.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:31.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:31.780 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:57:31.780 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:57:31.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:31.781 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:57:31.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:32.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:32.879 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:32.879 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:57:32.879 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:57:32.880 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:32.880 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:57:32.976 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/1839646198,v1:127.0.0.1:6809/1839646198] [v2:127.0.0.1:6810/1839646198,v1:127.0.0.1:6811/1839646198] exists,up 7efaf352-6197-49ba-8a33-1851edf4c342 2026-02-17T12:57:32.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:57:32.979 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:57:32.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:57:32.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:80: TEST_check_version_health_1: run_osd td/ver-health 2 2026-02-17T12:57:32.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ver-health 2026-02-17T12:57:32.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:57:32.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:57:32.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:57:32.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ver-health/2 2026-02-17T12:57:32.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:57:32.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:57:32.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:57:32.980 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:32.981 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:57:32.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ver-health/2 2026-02-17T12:57:32.983 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:57:32.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2b037137-5a2c-4dcc-978f-67b837baee5e 2026-02-17T12:57:32.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 2b037137-5a2c-4dcc-978f-67b837baee5e' 2026-02-17T12:57:32.984 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 2b037137-5a2c-4dcc-978f-67b837baee5e 2026-02-17T12:57:32.984 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:57:32.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC8ZZRpMVwEOxAANqNOwD5cg4N8J1taWKlpig== 2026-02-17T12:57:32.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC8ZZRpMVwEOxAANqNOwD5cg4N8J1taWKlpig=="}' 2026-02-17T12:57:32.991 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2b037137-5a2c-4dcc-978f-67b837baee5e -i td/ver-health/2/new.json 2026-02-17T12:57:33.092 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:57:33.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ver-health/2/new.json 2026-02-17T12:57:33.100 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC8ZZRpMVwEOxAANqNOwD5cg4N8J1taWKlpig== --osd-uuid 2b037137-5a2c-4dcc-978f-67b837baee5e 2026-02-17T12:57:33.116 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:33.115+0000 7f75f0815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:33.118 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:33.116+0000 7f75f0815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:33.119 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:33.117+0000 7f75f0815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:33.119 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:33.118+0000 7f75f0815780 -1 bdev(0x5555b6d15c00 td/ver-health/2/block) open stat got: (1) Operation not permitted 2026-02-17T12:57:33.119 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:33.118+0000 7f75f0815780 -1 bluestore(td/ver-health/2) _read_fsid unparsable uuid 2026-02-17T12:57:35.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ver-health/2/keyring 2026-02-17T12:57:35.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:57:35.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:57:35.257 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:57:35.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ver-health/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:57:35.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:57:35.358 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:57:35.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:57:35.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:57:35.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:57:35.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:57:35.374 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:35.372+0000 7f7448953780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:35.375 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:35.374+0000 7f7448953780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:35.376 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:35.375+0000 7f7448953780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:35.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:57:35.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:57:35.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:57:35.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:57:35.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:57:35.456 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:35.457 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:57:35.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:57:35.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:35.457 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:57:35.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:36.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:36.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:36.550 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:57:36.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:57:36.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:36.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:57:36.644 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:36.950 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:36.949+0000 7f7448953780 -1 Falling back to public interface 2026-02-17T12:57:37.646 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:37.646 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:37.646 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:57:37.646 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:57:37.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:37.647 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:57:37.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:38.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:38.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:38.742 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:57:38.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:57:38.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:38.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:57:38.842 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:39.667 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:39.666+0000 7f7448953780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:57:39.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:39.843 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:39.843 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:57:39.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:57:39.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:39.844 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:57:39.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:40.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:40.942 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:40.942 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:57:40.943 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:57:40.943 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:40.943 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:57:41.046 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/175754627,v1:127.0.0.1:6817/175754627] [v2:127.0.0.1:6818/175754627,v1:127.0.0.1:6819/175754627] exists,up 2b037137-5a2c-4dcc-978f-67b837baee5e 2026-02-17T12:57:41.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:57:41.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:57:41.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:57:41.047 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:82: TEST_check_version_health_1: sleep 5 2026-02-17T12:57:46.048 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:83: TEST_check_version_health_1: ceph health detail 2026-02-17T12:57:46.141 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_OK 2026-02-17T12:57:46.146 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:85: TEST_check_version_health_1: ceph health detail 2026-02-17T12:57:46.147 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:85: TEST_check_version_health_1: grep DAEMON_OLD_VERSION 2026-02-17T12:57:46.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:87: TEST_check_version_health_1: kill_daemons td/ver-health KILL osd.1 2026-02-17T12:57:46.245 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:57:46.245 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:57:46.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:57:46.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:57:46.245 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:57:46.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:57:46.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:88: TEST_check_version_health_1: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-17T12:57:46.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:88: TEST_check_version_health_1: activate_osd td/ver-health 1 2026-02-17T12:57:46.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ver-health 2026-02-17T12:57:46.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:57:46.354 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T12:57:46.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:57:46.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ver-health/1 2026-02-17T12:57:46.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:57:46.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:57:46.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:57:46.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:57:46.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ver-health/1' 2026-02-17T12:57:46.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ver-health/1/journal' 2026-02-17T12:57:46.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:57:46.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:57:46.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:57:46.356 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:57:46.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:57:46.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:57:46.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:57:46.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:57:46.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ver-health/1 2026-02-17T12:57:46.357 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T12:57:46.358 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:57:46.358 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:57:46.359 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ver-health/1/whoami 2026-02-17T12:57:46.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T12:57:46.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:57:46.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:57:46.359 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:57:46.373 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:46.372+0000 7f6f0a410780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:46.375 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:46.373+0000 7f6f0a410780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:46.376 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:46.374+0000 7f6f0a410780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:46.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T12:57:46.453 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:57:46.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:57:46.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:57:46.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:57:46.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:46.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:57:46.454 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:57:46.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:46.455 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:57:46.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:47.465 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:47.464+0000 7f6f0a410780 -1 Falling back to public interface 2026-02-17T12:57:47.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:47.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:47.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:57:47.552 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:57:47.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:47.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:57:47.650 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:48.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:48.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:48.651 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:57:48.652 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:57:48.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:48.652 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:57:48.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:49.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:49.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:49.749 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:57:49.749 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:57:49.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:49.750 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:57:49.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:50.180 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:50.179+0000 7f6f0a410780 -1 osd.1 14 log_to_monitors true 2026-02-17T12:57:50.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:50.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:50.849 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:57:50.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:57:50.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:50.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:57:50.949 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 17 up_thru 0 down_at 15 last_clean_interval [9,14) [v2:127.0.0.1:6808/2046114807,v1:127.0.0.1:6809/2046114807] [v2:127.0.0.1:6810/2046114807,v1:127.0.0.1:6811/2046114807] exists,up 7efaf352-6197-49ba-8a33-1851edf4c342 2026-02-17T12:57:50.950 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:57:50.950 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:57:50.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:57:50.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:90: TEST_check_version_health_1: wait_for_health_string 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:57:50.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:57:50.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-17T12:57:50.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-17T12:57:50.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-17T12:57:50.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-17T12:57:50.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:57:50.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:57:50.951 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:57:51.049 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-17T12:57:51.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-17T12:57:51.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-17T12:57:51.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-17T12:57:51.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-17T12:57:51.050 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:92: TEST_check_version_health_1: ceph health detail 2026-02-17T12:57:51.144 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN There is a daemon running an older version of ceph 2026-02-17T12:57:51.144 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] DAEMON_OLD_VERSION: There is a daemon running an older version of ceph 2026-02-17T12:57:51.145 INFO:tasks.workunit.client.0.trial155.stdout: osd.1 is running an older version of ceph: 01.00.00-gversion-test 2026-02-17T12:57:51.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:94: TEST_check_version_health_1: ceph health detail 2026-02-17T12:57:51.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:94: TEST_check_version_health_1: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:57:51.248 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:95: TEST_check_version_health_1: ceph health detail 2026-02-17T12:57:51.249 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:95: TEST_check_version_health_1: grep -q '^[[]WRN[]] DAEMON_OLD_VERSION: There is a daemon running an older version of ceph' 2026-02-17T12:57:51.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:96: TEST_check_version_health_1: ceph health detail 2026-02-17T12:57:51.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:96: TEST_check_version_health_1: grep -q 'osd.1 is running an older version of ceph: 01.00.00-gversion-test' 2026-02-17T12:57:51.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:98: TEST_check_version_health_1: kill_daemons td/ver-health KILL osd.2 2026-02-17T12:57:51.450 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:57:51.450 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:57:51.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:57:51.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:57:51.450 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:57:51.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:57:51.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:99: TEST_check_version_health_1: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-17T12:57:51.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:99: TEST_check_version_health_1: activate_osd td/ver-health 2 2026-02-17T12:57:51.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ver-health 2026-02-17T12:57:51.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:57:51.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T12:57:51.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:57:51.558 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ver-health/2 2026-02-17T12:57:51.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:57:51.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:57:51.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:57:51.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:57:51.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-17T12:57:51.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-17T12:57:51.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:57:51.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:57:51.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:57:51.559 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:57:51.559 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:57:51.560 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:57:51.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:57:51.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:57:51.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:57:51.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ver-health/2 2026-02-17T12:57:51.561 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:57:51.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T12:57:51.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:57:51.562 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ver-health/2/whoami 2026-02-17T12:57:51.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T12:57:51.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:57:51.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:57:51.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:57:51.573 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:51.571+0000 7fa430fb4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:51.574 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:51.572+0000 7fa430fb4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:51.575 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:51.573+0000 7fa430fb4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:51.653 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T12:57:51.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:57:51.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:57:51.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:57:51.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:57:51.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:51.654 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:57:51.654 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:57:51.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:51.655 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:57:51.751 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:52.662 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:52.660+0000 7fa430fb4780 -1 Falling back to public interface 2026-02-17T12:57:52.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:52.752 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:52.753 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:57:52.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:57:52.753 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:52.754 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:57:52.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:53.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:53.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:53.849 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:57:53.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:57:53.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:53.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:57:53.945 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:54.946 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:54.947 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:54.947 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:57:54.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:57:54.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:54.948 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:57:55.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:55.369 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:55.366+0000 7fa430fb4780 -1 osd.2 17 log_to_monitors true 2026-02-17T12:57:56.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:56.045 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:56.045 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:57:56.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:57:56.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:56.046 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:57:56.143 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 20 up_thru 0 down_at 18 last_clean_interval [14,17) [v2:127.0.0.1:6816/3549480593,v1:127.0.0.1:6817/3549480593] [v2:127.0.0.1:6818/3549480593,v1:127.0.0.1:6819/3549480593] exists,up 2b037137-5a2c-4dcc-978f-67b837baee5e 2026-02-17T12:57:56.144 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:57:56.144 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:57:56.144 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:57:56.144 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:100: TEST_check_version_health_1: kill_daemons td/ver-health KILL osd.0 2026-02-17T12:57:56.145 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:57:56.145 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:57:56.145 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:57:56.145 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:57:56.145 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:57:56.252 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:57:56.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:101: TEST_check_version_health_1: ceph_debug_version_for_testing=02.00.00-gversion-test 2026-02-17T12:57:56.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:101: TEST_check_version_health_1: activate_osd td/ver-health 0 2026-02-17T12:57:56.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ver-health 2026-02-17T12:57:56.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:57:56.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T12:57:56.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:57:56.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ver-health/0 2026-02-17T12:57:56.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:57:56.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:57:56.253 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:57:56.254 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:57:56.255 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ver-health/0 2026-02-17T12:57:56.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T12:57:56.256 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:57:56.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:57:56.257 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ver-health/0/whoami 2026-02-17T12:57:56.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T12:57:56.257 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:57:56.258 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:57:56.258 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:57:56.269 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:56.267+0000 7f04c3622780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:56.271 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:56.268+0000 7f04c3622780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:56.272 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:56.269+0000 7f04c3622780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:57:56.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T12:57:56.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:57:56.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:57:56.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:57:56.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:57:56.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:56.351 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:57:56.351 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:57:56.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:56.352 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:57:56.446 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:57.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:57.448 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:57.448 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:57:57.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:57:57.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:57.449 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:57:57.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:57.598 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:57:57.595+0000 7f04c3622780 -1 Falling back to public interface 2026-02-17T12:57:58.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:58.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:58.546 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:57:58.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:57:58.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:58.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:57:58.642 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:57:59.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:57:59.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:57:59.643 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:57:59.644 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:57:59.644 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:57:59.644 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:57:59.738 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:00.311 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:00.308+0000 7f04c3622780 -1 osd.0 20 log_to_monitors true 2026-02-17T12:58:00.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:00.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:00.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:58:00.740 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:58:00.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:00.741 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:00.837 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 23 up_thru 0 down_at 21 last_clean_interval [5,20) [v2:127.0.0.1:6800/3333464660,v1:127.0.0.1:6801/3333464660] [v2:127.0.0.1:6802/3333464660,v1:127.0.0.1:6803/3333464660] exists,up 69841df6-19d4-49cd-8abb-7a701352552b 2026-02-17T12:58:00.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:58:00.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:58:00.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:58:00.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:103: TEST_check_version_health_1: wait_for_health_string 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:58:00.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:58:00.838 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-17T12:58:00.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-17T12:58:00.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-17T12:58:00.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-17T12:58:00.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:58:00.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:58:00.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:58:00.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-17T12:58:00.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-17T12:58:00.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-17T12:58:00.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-17T12:58:00.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-17T12:58:00.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:105: TEST_check_version_health_1: ceph health detail 2026-02-17T12:58:01.032 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_ERR There are daemons running multiple old versions of ceph 2026-02-17T12:58:01.032 INFO:tasks.workunit.client.0.trial155.stdout:[ERR] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph 2026-02-17T12:58:01.032 INFO:tasks.workunit.client.0.trial155.stdout: osd.1 osd.2 are running an older version of ceph: 01.00.00-gversion-test 2026-02-17T12:58:01.032 INFO:tasks.workunit.client.0.trial155.stdout: osd.0 is running an older version of ceph: 02.00.00-gversion-test 2026-02-17T12:58:01.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:106: TEST_check_version_health_1: ceph health detail 2026-02-17T12:58:01.038 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:106: TEST_check_version_health_1: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:58:01.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:107: TEST_check_version_health_1: ceph health detail 2026-02-17T12:58:01.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:107: TEST_check_version_health_1: grep -q '^[[]ERR[]] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph' 2026-02-17T12:58:01.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:108: TEST_check_version_health_1: ceph health detail 2026-02-17T12:58:01.236 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:108: TEST_check_version_health_1: grep -q 'osd.1 osd.2 are running an older version of ceph: 01.00.00-gversion-test' 2026-02-17T12:58:01.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:109: TEST_check_version_health_1: ceph health detail 2026-02-17T12:58:01.337 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:109: TEST_check_version_health_1: grep -q 'osd.0 is running an older version of ceph: 02.00.00-gversion-test' 2026-02-17T12:58:01.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:35: run: teardown td/ver-health 2026-02-17T12:58:01.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ver-health 2026-02-17T12:58:01.436 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:58:01.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ver-health KILL 2026-02-17T12:58:01.437 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:58:01.437 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:58:01.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:58:01.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:58:01.437 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:58:01.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:58:01.545 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:58:01.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:58:01.546 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:58:01.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:58:01.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:58:01.547 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:58:01.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:58:01.548 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:58:01.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:58:01.549 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:58:01.549 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:58:01.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:58:01.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ver-health 2026-02-17T12:58:01.559 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:58:01.559 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.559 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.559 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.189587 2026-02-17T12:58:01.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:58:01.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:58:01.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:32: run: for func in $funcs 2026-02-17T12:58:01.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:33: run: setup td/ver-health 2026-02-17T12:58:01.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ver-health 2026-02-17T12:58:01.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ver-health 2026-02-17T12:58:01.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ver-health 2026-02-17T12:58:01.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:58:01.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ver-health KILL 2026-02-17T12:58:01.561 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:58:01.562 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:58:01.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:58:01.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:58:01.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:58:01.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:58:01.562 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:58:01.563 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:58:01.563 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:58:01.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:58:01.564 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:58:01.565 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:58:01.565 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:58:01.565 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:58:01.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:58:01.566 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:58:01.566 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:58:01.567 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:58:01.567 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ver-health 2026-02-17T12:58:01.569 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:58:01.569 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.569 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.569 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.189587 2026-02-17T12:58:01.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:58:01.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:58:01.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ver-health 2026-02-17T12:58:01.571 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:58:01.571 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.571 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.571 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.189587 2026-02-17T12:58:01.572 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:58:01.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:58:01.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:58:01.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-17T12:58:01.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:34: run: TEST_check_version_health_2 td/ver-health 2026-02-17T12:58:01.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:114: TEST_check_version_health_2: local dir=td/ver-health 2026-02-17T12:58:01.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:117: TEST_check_version_health_2: CEPH_ARGS='--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:58:01.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:119: TEST_check_version_health_2: setup td/ver-health 2026-02-17T12:58:01.574 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ver-health 2026-02-17T12:58:01.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ver-health 2026-02-17T12:58:01.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ver-health 2026-02-17T12:58:01.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:58:01.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ver-health KILL 2026-02-17T12:58:01.575 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:58:01.575 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:58:01.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:58:01.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:58:01.575 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:58:01.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:58:01.576 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:58:01.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:58:01.577 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:58:01.577 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:58:01.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:58:01.578 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:58:01.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:58:01.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:58:01.579 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:58:01.579 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:58:01.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:58:01.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:58:01.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ver-health 2026-02-17T12:58:01.582 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:58:01.582 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.582 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.582 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.189587 2026-02-17T12:58:01.583 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:58:01.583 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:58:01.583 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ver-health 2026-02-17T12:58:01.584 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:58:01.584 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.584 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.584 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.189587 2026-02-17T12:58:01.585 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:58:01.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:58:01.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:58:01.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-17T12:58:01.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:122: TEST_check_version_health_2: run_mon td/ver-health a --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-17T12:58:01.586 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ver-health 2026-02-17T12:58:01.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:58:01.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:58:01.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:58:01.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ver-health/a 2026-02-17T12:58:01.587 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ver-health/a --run-dir=td/ver-health --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-17T12:58:01.606 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:58:01.606 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:01.606 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:01.606 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:01.606 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.606 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.606 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:01.607 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/a '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7165 --mon_warn_older_version_delay=0 2026-02-17T12:58:01.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:58:01.633 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:58:01.633 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:58:01.633 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:58:01.633 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:58:01.633 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:58:01.635 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:58:01.635 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:58:01.635 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:58:01.635 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:58:01.635 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.635 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.635 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.a.asok 2026-02-17T12:58:01.635 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:58:01.635 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.a.asok config get fsid 2026-02-17T12:58:01.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:58:01.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:58:01.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:58:01.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:58:01.679 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:58:01.680 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:58:01.680 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:58:01.680 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:58:01.680 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:58:01.681 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.681 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.681 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.a.asok 2026-02-17T12:58:01.681 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:58:01.681 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.a.asok config get mon_host 2026-02-17T12:58:01.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:123: TEST_check_version_health_2: run_mon td/ver-health b --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-17T12:58:01.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ver-health 2026-02-17T12:58:01.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:58:01.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2026-02-17T12:58:01.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:58:01.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ver-health/b 2026-02-17T12:58:01.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ver-health/b --run-dir=td/ver-health --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-17T12:58:01.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:58:01.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:01.742 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:01.742 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:01.743 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.743 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.743 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:01.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/b '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7166 --mon_warn_older_version_delay=0 2026-02-17T12:58:01.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:58:01.768 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b fsid 2026-02-17T12:58:01.768 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:58:01.768 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:58:01.769 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:58:01.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:58:01.770 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:58:01.770 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:58:01.770 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:58:01.770 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:58:01.770 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.770 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.770 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.b.asok 2026-02-17T12:58:01.770 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:58:01.771 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.b.asok config get fsid 2026-02-17T12:58:01.813 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b mon_host 2026-02-17T12:58:01.813 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:58:01.813 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:58:01.814 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:58:01.814 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:58:01.815 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:58:01.815 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:58:01.815 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:58:01.815 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:58:01.815 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.815 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.815 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.b.asok 2026-02-17T12:58:01.816 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:58:01.816 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.b.asok config get mon_host 2026-02-17T12:58:01.865 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:124: TEST_check_version_health_2: run_osd td/ver-health 0 2026-02-17T12:58:01.865 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ver-health 2026-02-17T12:58:01.865 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:58:01.865 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:58:01.865 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:58:01.865 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ver-health/0 2026-02-17T12:58:01.865 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:58:01.865 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:01.866 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:58:01.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:58:01.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:58:01.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ver-health/0 2026-02-17T12:58:01.868 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:58:01.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=abcc74a4-e27b-4723-a47e-0375da05349d 2026-02-17T12:58:01.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 abcc74a4-e27b-4723-a47e-0375da05349d' 2026-02-17T12:58:01.869 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 abcc74a4-e27b-4723-a47e-0375da05349d 2026-02-17T12:58:01.869 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:58:01.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDZZZRpH5kuNBAAs6OUBLRTGf49Y0OvNjdChA== 2026-02-17T12:58:01.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDZZZRpH5kuNBAAs6OUBLRTGf49Y0OvNjdChA=="}' 2026-02-17T12:58:01.877 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new abcc74a4-e27b-4723-a47e-0375da05349d -i td/ver-health/0/new.json 2026-02-17T12:58:07.980 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:58:07.986 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ver-health/0/new.json 2026-02-17T12:58:07.987 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDZZZRpH5kuNBAAs6OUBLRTGf49Y0OvNjdChA== --osd-uuid abcc74a4-e27b-4723-a47e-0375da05349d 2026-02-17T12:58:08.005 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:08.002+0000 7fd916cd9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:08.006 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:08.004+0000 7fd916cd9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:08.007 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:08.005+0000 7fd916cd9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:08.007 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:08.005+0000 7fd916cd9780 -1 bdev(0x564fae1d9c00 td/ver-health/0/block) open stat got: (1) Operation not permitted 2026-02-17T12:58:08.008 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:08.005+0000 7fd916cd9780 -1 bluestore(td/ver-health/0) _read_fsid unparsable uuid 2026-02-17T12:58:10.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ver-health/0/keyring 2026-02-17T12:58:10.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:58:10.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:58:10.128 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:58:10.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ver-health/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:58:10.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:58:10.233 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:58:10.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:58:10.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:58:10.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:58:10.234 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:58:10.249 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:10.247+0000 7f7056816780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:10.250 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:10.248+0000 7f7056816780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:10.251 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:10.249+0000 7f7056816780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:10.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:58:10.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:58:10.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:58:10.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:58:10.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:58:10.330 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:10.331 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:58:10.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:58:10.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:10.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:10.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:11.428 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:11.428 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:11.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:58:11.429 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:58:11.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:11.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:11.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:11.583 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:11.580+0000 7f7056816780 -1 Falling back to public interface 2026-02-17T12:58:12.524 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:12.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:12.525 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:58:12.525 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:58:12.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:12.526 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:12.621 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:13.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:13.623 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:13.623 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:58:13.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:58:13.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:13.624 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:13.722 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:14.285 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:14.282+0000 7f7056816780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:58:14.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:14.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:14.724 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:58:14.725 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:58:14.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:14.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:14.823 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:15.824 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:15.824 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:15.824 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:58:15.825 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:58:15.825 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:15.825 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:15.919 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2532986796,v1:127.0.0.1:6801/2532986796] [v2:127.0.0.1:6802/2532986796,v1:127.0.0.1:6803/2532986796] exists,up abcc74a4-e27b-4723-a47e-0375da05349d 2026-02-17T12:58:15.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:58:15.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:58:15.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:58:15.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:125: TEST_check_version_health_2: run_osd td/ver-health 1 2026-02-17T12:58:15.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ver-health 2026-02-17T12:58:15.923 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ver-health/1 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ver-health/1' 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ver-health/1/journal' 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:58:15.924 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:58:15.925 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:58:15.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:58:15.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:58:15.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:58:15.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:58:15.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:58:15.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:58:15.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ver-health/1 2026-02-17T12:58:15.926 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:58:15.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b51f9b1b-9aa0-4b5f-8da8-93d6c1247e37 2026-02-17T12:58:15.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 b51f9b1b-9aa0-4b5f-8da8-93d6c1247e37' 2026-02-17T12:58:15.927 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 b51f9b1b-9aa0-4b5f-8da8-93d6c1247e37 2026-02-17T12:58:15.927 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:58:15.934 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDnZZRp0JGdNxAAjxqN4PNWaWd+y6ksNx07fg== 2026-02-17T12:58:15.934 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDnZZRp0JGdNxAAjxqN4PNWaWd+y6ksNx07fg=="}' 2026-02-17T12:58:15.934 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b51f9b1b-9aa0-4b5f-8da8-93d6c1247e37 -i td/ver-health/1/new.json 2026-02-17T12:58:16.036 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:58:16.041 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ver-health/1/new.json 2026-02-17T12:58:16.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDnZZRp0JGdNxAAjxqN4PNWaWd+y6ksNx07fg== --osd-uuid b51f9b1b-9aa0-4b5f-8da8-93d6c1247e37 2026-02-17T12:58:16.059 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:16.057+0000 7ff23fa3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:16.061 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:16.058+0000 7ff23fa3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:16.061 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:16.059+0000 7ff23fa3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:16.062 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:16.060+0000 7ff23fa3f780 -1 bdev(0x55fc43701c00 td/ver-health/1/block) open stat got: (1) Operation not permitted 2026-02-17T12:58:16.062 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:16.060+0000 7ff23fa3f780 -1 bluestore(td/ver-health/1) _read_fsid unparsable uuid 2026-02-17T12:58:18.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ver-health/1/keyring 2026-02-17T12:58:18.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:58:18.176 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:58:18.177 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:58:18.177 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ver-health/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:58:18.277 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:58:18.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:58:18.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:58:18.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:58:18.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:58:18.278 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:58:18.294 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:18.291+0000 7f20a649b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:18.295 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:18.293+0000 7f20a649b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:18.296 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:18.294+0000 7f20a649b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:18.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:58:18.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:58:18.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:58:18.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:58:18.375 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:58:18.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:18.376 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:58:18.376 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:58:18.377 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:18.377 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:58:18.471 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:19.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:19.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:19.473 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:58:19.473 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:58:19.474 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:19.474 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:58:19.570 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:19.626 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:19.623+0000 7f20a649b780 -1 Falling back to public interface 2026-02-17T12:58:20.571 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:20.572 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:20.572 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:58:20.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:58:20.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:20.573 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:58:20.668 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:21.669 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:21.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:21.670 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:58:21.670 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:58:21.671 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:21.671 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:58:21.766 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:22.329 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:22.326+0000 7f20a649b780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:58:22.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:22.767 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:22.768 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:58:22.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:58:22.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:22.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:58:22.867 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:23.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:23.869 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:23.869 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:58:23.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:58:23.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:23.870 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:58:23.968 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/985177674,v1:127.0.0.1:6809/985177674] [v2:127.0.0.1:6810/985177674,v1:127.0.0.1:6811/985177674] exists,up b51f9b1b-9aa0-4b5f-8da8-93d6c1247e37 2026-02-17T12:58:23.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:58:23.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:58:23.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:58:23.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:126: TEST_check_version_health_2: run_osd td/ver-health 2 2026-02-17T12:58:23.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ver-health 2026-02-17T12:58:23.972 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:58:23.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:58:23.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:58:23.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ver-health/2 2026-02-17T12:58:23.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:58:23.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:58:23.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:58:23.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:58:23.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-17T12:58:23.973 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:58:23.974 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ver-health/2 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=04bbba9b-c238-4a82-a374-e66f35c28cbb 2026-02-17T12:58:23.975 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 04bbba9b-c238-4a82-a374-e66f35c28cbb' 2026-02-17T12:58:23.976 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 04bbba9b-c238-4a82-a374-e66f35c28cbb 2026-02-17T12:58:23.976 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:58:23.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDvZZRpEBCFOhAAzX5nYhB8SJJuMb3GAiZfcA== 2026-02-17T12:58:23.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDvZZRpEBCFOhAAzX5nYhB8SJJuMb3GAiZfcA=="}' 2026-02-17T12:58:23.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 04bbba9b-c238-4a82-a374-e66f35c28cbb -i td/ver-health/2/new.json 2026-02-17T12:58:24.085 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:58:24.091 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ver-health/2/new.json 2026-02-17T12:58:24.092 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDvZZRpEBCFOhAAzX5nYhB8SJJuMb3GAiZfcA== --osd-uuid 04bbba9b-c238-4a82-a374-e66f35c28cbb 2026-02-17T12:58:24.110 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:24.108+0000 7f842cd3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:24.112 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:24.109+0000 7f842cd3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:24.112 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:24.110+0000 7f842cd3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:24.113 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:24.111+0000 7f842cd3b780 -1 bdev(0x55a0e3ac3c00 td/ver-health/2/block) open stat got: (1) Operation not permitted 2026-02-17T12:58:24.113 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:24.111+0000 7f842cd3b780 -1 bluestore(td/ver-health/2) _read_fsid unparsable uuid 2026-02-17T12:58:26.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ver-health/2/keyring 2026-02-17T12:58:26.231 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:58:26.231 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:58:26.232 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:58:26.232 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ver-health/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:58:26.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:58:26.333 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:58:26.333 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:58:26.334 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:58:26.334 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:58:26.334 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:58:26.349 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:26.347+0000 7f948a3d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:26.350 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:26.348+0000 7f948a3d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:26.351 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:26.349+0000 7f948a3d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:26.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:58:26.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:58:26.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:58:26.432 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:58:26.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:58:26.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:26.433 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:58:26.433 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:58:26.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:26.434 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:58:26.529 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:27.530 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:27.531 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:27.531 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:58:27.531 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:58:27.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:27.532 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:58:27.626 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:27.936 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:27.934+0000 7f948a3d4780 -1 Falling back to public interface 2026-02-17T12:58:28.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:28.628 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:28.628 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:58:28.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:58:28.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:28.629 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:58:28.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:29.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:29.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:29.726 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:58:29.727 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:58:29.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:29.727 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:58:29.825 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:30.666 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:30.665+0000 7f948a3d4780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:58:30.827 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:30.827 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:30.827 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:58:30.828 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:58:30.828 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:30.828 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:58:30.926 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:31.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:31.928 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:31.928 INFO:tasks.workunit.client.0.trial155.stdout:5 2026-02-17T12:58:31.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T12:58:31.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:31.929 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:58:32.022 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/3466640686,v1:127.0.0.1:6817/3466640686] [v2:127.0.0.1:6818/3466640686,v1:127.0.0.1:6819/3466640686] exists,up 04bbba9b-c238-4a82-a374-e66f35c28cbb 2026-02-17T12:58:32.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:58:32.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:58:32.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:58:32.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:127: TEST_check_version_health_2: run_mgr td/ver-health x 2026-02-17T12:58:32.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ver-health 2026-02-17T12:58:32.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:58:32.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T12:58:32.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:58:32.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ver-health/x 2026-02-17T12:58:32.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:58:32.123 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:58:32.123 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:32.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:32.124 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:32.124 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:32.124 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:32.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:32.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:58:32.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ver-health/x '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:58:32.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:128: TEST_check_version_health_2: run_mgr td/ver-health y 2026-02-17T12:58:32.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ver-health 2026-02-17T12:58:32.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T12:58:32.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=y 2026-02-17T12:58:32.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T12:58:32.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ver-health/y 2026-02-17T12:58:32.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T12:58:32.240 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T12:58:32.240 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:32.241 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:32.241 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:32.241 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:32.241 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:32.241 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:32.242 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:58:32.242 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id y --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ver-health/y '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T12:58:32.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:129: TEST_check_version_health_2: run_mds td/ver-health m 2026-02-17T12:58:32.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:579: run_mds: local dir=td/ver-health 2026-02-17T12:58:32.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:580: run_mds: shift 2026-02-17T12:58:32.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:581: run_mds: local id=m 2026-02-17T12:58:32.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:582: run_mds: shift 2026-02-17T12:58:32.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:583: run_mds: local data=td/ver-health/m 2026-02-17T12:58:32.260 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:586: run_mds: get_asok_path 2026-02-17T12:58:32.260 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:32.260 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:32.260 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:32.261 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:32.261 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:32.261 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:32.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:586: run_mds: ceph-mds --id m --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ver-health/m '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' 2026-02-17T12:58:32.276 INFO:tasks.workunit.client.0.trial155.stdout:starting mds.m at 2026-02-17T12:58:32.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:130: TEST_check_version_health_2: run_mds td/ver-health n 2026-02-17T12:58:32.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:579: run_mds: local dir=td/ver-health 2026-02-17T12:58:32.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:580: run_mds: shift 2026-02-17T12:58:32.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:581: run_mds: local id=n 2026-02-17T12:58:32.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:582: run_mds: shift 2026-02-17T12:58:32.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:583: run_mds: local data=td/ver-health/n 2026-02-17T12:58:32.281 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:586: run_mds: get_asok_path 2026-02-17T12:58:32.281 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:32.281 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:32.281 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:32.281 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:32.281 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:32.281 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:32.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:586: run_mds: ceph-mds --id n --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ver-health/n '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' 2026-02-17T12:58:32.296 INFO:tasks.workunit.client.0.trial155.stdout:starting mds.n at 2026-02-17T12:58:32.299 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:132: TEST_check_version_health_2: sleep 5 2026-02-17T12:58:37.300 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:133: TEST_check_version_health_2: ceph health detail 2026-02-17T12:58:37.545 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_OK 2026-02-17T12:58:37.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:135: TEST_check_version_health_2: ceph health detail 2026-02-17T12:58:37.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:135: TEST_check_version_health_2: grep DAEMON_OLD_VERSION 2026-02-17T12:58:37.803 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:137: TEST_check_version_health_2: kill_daemons td/ver-health KILL mon.b 2026-02-17T12:58:37.804 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:58:37.804 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:58:37.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:58:37.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:58:37.804 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:58:37.910 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:58:37.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:138: TEST_check_version_health_2: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-17T12:58:37.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:138: TEST_check_version_health_2: run_mon td/ver-health b --mon_warn_older_version_delay=0 2026-02-17T12:58:37.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ver-health 2026-02-17T12:58:37.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:58:37.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2026-02-17T12:58:37.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:58:37.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ver-health/b 2026-02-17T12:58:37.911 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ver-health/b --run-dir=td/ver-health --mon_warn_older_version_delay=0 2026-02-17T12:58:37.924 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:37.923+0000 7f4cf372bd80 -1 'td/ver-health/b' already exists and is not empty: monitor may already exist 2026-02-17T12:58:37.926 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:58:37.927 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:37.927 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:37.927 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:37.927 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:37.927 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:37.927 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:37.927 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/b '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --mon_warn_older_version_delay=0 2026-02-17T12:58:37.959 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:58:37.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b fsid 2026-02-17T12:58:37.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:58:37.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:58:37.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:58:37.961 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:58:37.961 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:58:37.961 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:58:37.961 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:58:37.961 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:58:37.961 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:37.962 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:37.962 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.b.asok 2026-02-17T12:58:37.962 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:58:37.962 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.b.asok config get fsid 2026-02-17T12:58:38.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b mon_host 2026-02-17T12:58:38.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:58:38.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:58:38.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:58:38.006 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:58:38.006 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:58:38.006 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:58:38.006 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:58:38.007 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:58:38.007 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:38.008 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:38.008 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.b.asok 2026-02-17T12:58:38.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:58:38.008 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.b.asok config get mon_host 2026-02-17T12:58:38.052 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:142: TEST_check_version_health_2: kill_daemons td/ver-health KILL mds.m 2026-02-17T12:58:38.052 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:58:38.053 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:58:38.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:58:38.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:58:38.053 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:58:38.159 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:58:38.159 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:143: TEST_check_version_health_2: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-17T12:58:38.159 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:143: TEST_check_version_health_2: run_mds td/ver-health m 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:579: run_mds: local dir=td/ver-health 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:580: run_mds: shift 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:581: run_mds: local id=m 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:582: run_mds: shift 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:583: run_mds: local data=td/ver-health/m 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:586: run_mds: get_asok_path 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:38.160 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:38.161 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:586: run_mds: ceph-mds --id m --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ver-health/m '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' 2026-02-17T12:58:38.175 INFO:tasks.workunit.client.0.trial155.stdout:starting mds.m at 2026-02-17T12:58:38.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:145: TEST_check_version_health_2: wait_for_health_string 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-17T12:58:38.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-17T12:58:38.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-17T12:58:38.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-17T12:58:38.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-17T12:58:38.178 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-17T12:58:38.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:58:38.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:58:38.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-17T12:58:38.403 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:58:39.404 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:58:39.404 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:58:39.405 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:58:39.405 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-17T12:58:39.630 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:58:40.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:58:40.631 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:58:40.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:58:40.632 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-17T12:58:40.859 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:58:41.860 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:58:41.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:58:41.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:58:41.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-17T12:58:42.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:58:43.089 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:58:43.089 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:58:43.089 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:58:43.090 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-17T12:58:43.313 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:58:44.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:58:44.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:58:44.315 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:58:44.316 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-17T12:58:44.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:58:45.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:58:45.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:58:45.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:58:45.547 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-17T12:58:45.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:58:46.773 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:58:46.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:58:46.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:58:46.774 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-17T12:58:47.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-17T12:58:47.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-17T12:58:47.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-17T12:58:47.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-17T12:58:47.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-17T12:58:47.006 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:147: TEST_check_version_health_2: ceph health detail 2026-02-17T12:58:47.251 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN There are daemons running an older version of ceph 2026-02-17T12:58:47.251 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] DAEMON_OLD_VERSION: There are daemons running an older version of ceph 2026-02-17T12:58:47.252 INFO:tasks.workunit.client.0.trial155.stdout: mon.b mds.m are running an older version of ceph: 01.00.00-gversion-test 2026-02-17T12:58:47.259 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:149: TEST_check_version_health_2: ceph health detail 2026-02-17T12:58:47.259 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:149: TEST_check_version_health_2: grep -q 'HEALTH_WARN .*There are daemons running an older version of ceph' 2026-02-17T12:58:47.514 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:150: TEST_check_version_health_2: ceph health detail 2026-02-17T12:58:47.515 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:150: TEST_check_version_health_2: grep -q '^[[]WRN[]] DAEMON_OLD_VERSION: There are daemons running an older version of ceph' 2026-02-17T12:58:47.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:151: TEST_check_version_health_2: ceph health detail 2026-02-17T12:58:47.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:151: TEST_check_version_health_2: grep -q 'mon.b mds.m are running an older version of ceph: 01.00.00-gversion-test' 2026-02-17T12:58:48.022 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:153: TEST_check_version_health_2: kill_daemons td/ver-health KILL osd.2 2026-02-17T12:58:48.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:58:48.023 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:58:48.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:58:48.023 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:58:48.024 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:58:48.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:58:48.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:154: TEST_check_version_health_2: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-17T12:58:48.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:154: TEST_check_version_health_2: activate_osd td/ver-health 2 2026-02-17T12:58:48.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ver-health 2026-02-17T12:58:48.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:58:48.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T12:58:48.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:58:48.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ver-health/2 2026-02-17T12:58:48.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:48.133 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:58:48.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:58:48.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ver-health/2 2026-02-17T12:58:48.135 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T12:58:48.135 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:58:48.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:58:48.136 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ver-health/2/whoami 2026-02-17T12:58:48.136 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T12:58:48.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:58:48.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:58:48.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:58:48.150 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:48.149+0000 7f3a2e41c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:48.151 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:48.150+0000 7f3a2e41c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:48.152 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:48.151+0000 7f3a2e41c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:48.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T12:58:48.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:58:48.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:58:48.322 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:58:48.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:58:48.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:48.323 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:58:48.323 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:58:48.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:48.324 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:58:48.510 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:49.485 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:49.484+0000 7f3a2e41c780 -1 Falling back to public interface 2026-02-17T12:58:49.512 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:49.512 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:49.512 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:58:49.512 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:58:49.513 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:49.513 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:58:49.702 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:50.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:50.703 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:50.704 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:58:50.704 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:58:50.705 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:50.705 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:58:50.896 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:51.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:51.897 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:51.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:58:51.898 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:58:51.898 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:51.899 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:58:52.085 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:52.189 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:52.187+0000 7f3a2e41c780 -1 osd.2 15 log_to_monitors true 2026-02-17T12:58:53.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:53.086 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:53.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:58:53.087 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:58:53.087 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:53.088 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:58:53.279 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 16 last_clean_interval [14,15) [v2:127.0.0.1:6816/3419210718,v1:127.0.0.1:6817/3419210718] [v2:127.0.0.1:6818/3419210718,v1:127.0.0.1:6819/3419210718] exists,up 04bbba9b-c238-4a82-a374-e66f35c28cbb 2026-02-17T12:58:53.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:58:53.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:58:53.280 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:58:53.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:155: TEST_check_version_health_2: kill_daemons td/ver-health KILL osd.0 2026-02-17T12:58:53.281 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:58:53.281 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:58:53.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:58:53.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:58:53.281 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:58:53.387 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:58:53.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:156: TEST_check_version_health_2: ceph_debug_version_for_testing=02.00.00-gversion-test 2026-02-17T12:58:53.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:156: TEST_check_version_health_2: activate_osd td/ver-health 0 2026-02-17T12:58:53.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ver-health 2026-02-17T12:58:53.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:58:53.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T12:58:53.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:58:53.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ver-health/0 2026-02-17T12:58:53.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:58:53.388 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:58:53.389 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:58:53.390 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:53.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:58:53.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:58:53.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:58:53.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:58:53.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:58:53.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:58:53.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:58:53.391 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:58:53.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:58:53.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:58:53.392 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ver-health/0 2026-02-17T12:58:53.392 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:58:53.393 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T12:58:53.393 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:58:53.393 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ver-health/0/whoami 2026-02-17T12:58:53.393 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T12:58:53.393 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:58:53.393 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:58:53.394 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:58:53.409 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:53.408+0000 7fecbe812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:53.411 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:53.409+0000 7fecbe812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:53.412 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:53.410+0000 7fecbe812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:58:53.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T12:58:53.580 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:58:53.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:58:53.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:58:53.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:58:53.581 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:53.581 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:58:53.582 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:58:53.582 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:53.582 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:53.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:54.750 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:54.748+0000 7fecbe812780 -1 Falling back to public interface 2026-02-17T12:58:54.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:54.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:54.769 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:58:54.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:58:54.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:54.770 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:54.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:55.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:55.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:55.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T12:58:55.958 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:58:55.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:55.958 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:56.157 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:57.157 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:57.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:57.158 INFO:tasks.workunit.client.0.trial155.stdout:3 2026-02-17T12:58:57.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T12:58:57.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:57.158 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:57.347 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:58:57.711 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:58:57.710+0000 7fecbe812780 -1 osd.0 18 log_to_monitors true 2026-02-17T12:58:58.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:58:58.348 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:58:58.349 INFO:tasks.workunit.client.0.trial155.stdout:4 2026-02-17T12:58:58.349 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T12:58:58.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:58:58.350 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:58:58.537 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 22 up_thru 0 down_at 20 last_clean_interval [5,18) [v2:127.0.0.1:6800/1235935906,v1:127.0.0.1:6801/1235935906] [v2:127.0.0.1:6802/1235935906,v1:127.0.0.1:6803/1235935906] exists,up abcc74a4-e27b-4723-a47e-0375da05349d 2026-02-17T12:58:58.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:58:58.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:58:58.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:58:58.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:158: TEST_check_version_health_2: wait_for_health_string 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:58:58.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:58:58.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-17T12:58:58.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-17T12:58:58.539 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-17T12:58:58.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-17T12:58:58.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:58:58.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:58:58.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:58:58.768 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:58:59.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:58:59.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:58:59.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:58:59.769 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:59:00.008 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:01.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:01.009 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:01.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:01.010 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:59:01.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:02.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:02.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:02.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:02.244 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:59:02.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-17T12:59:02.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-17T12:59:02.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-17T12:59:02.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-17T12:59:02.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-17T12:59:02.472 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:160: TEST_check_version_health_2: ceph health detail 2026-02-17T12:59:02.717 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_ERR There are daemons running multiple old versions of ceph 2026-02-17T12:59:02.718 INFO:tasks.workunit.client.0.trial155.stdout:[ERR] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph 2026-02-17T12:59:02.718 INFO:tasks.workunit.client.0.trial155.stdout: mon.b osd.2 mds.m are running an older version of ceph: 01.00.00-gversion-test 2026-02-17T12:59:02.718 INFO:tasks.workunit.client.0.trial155.stdout: osd.0 is running an older version of ceph: 02.00.00-gversion-test 2026-02-17T12:59:02.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:161: TEST_check_version_health_2: ceph health 2026-02-17T12:59:02.725 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:161: TEST_check_version_health_2: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:59:02.961 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:162: TEST_check_version_health_2: ceph health detail 2026-02-17T12:59:02.962 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:162: TEST_check_version_health_2: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:59:03.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:163: TEST_check_version_health_2: ceph health detail 2026-02-17T12:59:03.218 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:163: TEST_check_version_health_2: grep -q '^[[]ERR[]] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph' 2026-02-17T12:59:03.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:164: TEST_check_version_health_2: ceph health detail 2026-02-17T12:59:03.485 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:164: TEST_check_version_health_2: grep -q 'mon.b osd.2 mds.m are running an older version of ceph: 01.00.00-gversion-test' 2026-02-17T12:59:03.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:165: TEST_check_version_health_2: ceph health detail 2026-02-17T12:59:03.740 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:165: TEST_check_version_health_2: grep -q 'osd.0 is running an older version of ceph: 02.00.00-gversion-test' 2026-02-17T12:59:03.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:35: run: teardown td/ver-health 2026-02-17T12:59:03.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ver-health 2026-02-17T12:59:03.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:59:03.995 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ver-health KILL 2026-02-17T12:59:03.995 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:59:03.996 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:59:03.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:59:03.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:59:03.996 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:59:04.104 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:59:04.105 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:59:04.105 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:59:04.106 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:59:04.107 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:59:04.107 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:59:04.107 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:59:04.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:59:04.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:59:04.108 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:59:04.108 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:59:04.109 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:59:04.111 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:59:04.111 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ver-health 2026-02-17T12:59:04.121 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:59:04.121 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.122 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.122 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.189587 2026-02-17T12:59:04.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:59:04.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:59:04.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:32: run: for func in $funcs 2026-02-17T12:59:04.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:33: run: setup td/ver-health 2026-02-17T12:59:04.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ver-health 2026-02-17T12:59:04.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ver-health 2026-02-17T12:59:04.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ver-health 2026-02-17T12:59:04.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:59:04.124 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ver-health KILL 2026-02-17T12:59:04.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:59:04.124 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:59:04.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:59:04.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:59:04.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:59:04.125 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:59:04.125 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:59:04.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:59:04.126 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:59:04.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:59:04.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:59:04.127 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:59:04.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:59:04.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:59:04.129 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:59:04.129 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:59:04.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:59:04.130 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:59:04.131 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ver-health 2026-02-17T12:59:04.132 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:59:04.132 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.132 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.132 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.189587 2026-02-17T12:59:04.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:59:04.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:59:04.133 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ver-health 2026-02-17T12:59:04.134 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:59:04.134 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.134 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.134 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.189587 2026-02-17T12:59:04.135 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:59:04.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:59:04.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:59:04.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-17T12:59:04.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:34: run: TEST_check_version_health_3 td/ver-health 2026-02-17T12:59:04.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:170: TEST_check_version_health_3: local dir=td/ver-health 2026-02-17T12:59:04.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:173: TEST_check_version_health_3: CEPH_ARGS='--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:59:04.137 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:175: TEST_check_version_health_3: setup td/ver-health 2026-02-17T12:59:04.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ver-health 2026-02-17T12:59:04.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ver-health 2026-02-17T12:59:04.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ver-health 2026-02-17T12:59:04.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:59:04.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ver-health KILL 2026-02-17T12:59:04.138 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:59:04.138 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:59:04.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:59:04.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:59:04.138 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:59:04.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:59:04.139 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:59:04.139 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:59:04.139 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:59:04.140 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:59:04.140 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:59:04.140 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:59:04.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:59:04.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:59:04.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:59:04.142 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:59:04.142 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:59:04.143 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:59:04.143 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ver-health 2026-02-17T12:59:04.144 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:59:04.144 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.144 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.145 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.189587 2026-02-17T12:59:04.145 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:59:04.145 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:59:04.145 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ver-health 2026-02-17T12:59:04.146 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T12:59:04.147 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.147 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.147 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.189587 2026-02-17T12:59:04.148 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T12:59:04.149 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T12:59:04.149 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T12:59:04.149 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ver-health 1' TERM HUP INT 2026-02-17T12:59:04.149 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:178: TEST_check_version_health_3: run_mon td/ver-health a --public-addr=127.0.0.1:7165 2026-02-17T12:59:04.149 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ver-health 2026-02-17T12:59:04.149 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:59:04.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T12:59:04.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:59:04.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ver-health/a 2026-02-17T12:59:04.150 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ver-health/a --run-dir=td/ver-health --public-addr=127.0.0.1:7165 2026-02-17T12:59:04.168 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:59:04.169 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:59:04.169 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:59:04.169 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:59:04.169 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.169 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.169 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:04.169 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/a '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7165 2026-02-17T12:59:04.194 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:59:04.195 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T12:59:04.195 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:59:04.195 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:59:04.195 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:59:04.196 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:59:04.197 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:59:04.197 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:59:04.197 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:59:04.197 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:59:04.197 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.197 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.197 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.a.asok 2026-02-17T12:59:04.197 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:59:04.197 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.a.asok config get fsid 2026-02-17T12:59:04.242 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T12:59:04.242 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:59:04.242 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T12:59:04.242 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:59:04.242 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:59:04.242 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T12:59:04.242 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T12:59:04.243 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T12:59:04.243 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:59:04.244 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.244 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.244 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.a.asok 2026-02-17T12:59:04.244 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:59:04.244 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.a.asok config get mon_host 2026-02-17T12:59:04.287 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:179: TEST_check_version_health_3: run_mon td/ver-health b --public-addr=127.0.0.1:7166 2026-02-17T12:59:04.287 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ver-health 2026-02-17T12:59:04.287 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T12:59:04.287 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2026-02-17T12:59:04.287 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T12:59:04.287 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ver-health/b 2026-02-17T12:59:04.287 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ver-health/b --run-dir=td/ver-health --public-addr=127.0.0.1:7166 2026-02-17T12:59:04.305 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T12:59:04.305 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:59:04.305 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:59:04.305 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:59:04.306 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.306 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.306 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:04.306 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ver-health/b '--log-file=td/ver-health/$name.log' '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --mon-cluster-log-file=td/ver-health/log --run-dir=td/ver-health '--pid-file=td/ver-health/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7166 2026-02-17T12:59:04.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T12:59:04.332 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b fsid 2026-02-17T12:59:04.332 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:59:04.333 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:59:04.333 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T12:59:04.333 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T12:59:04.333 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:59:04.333 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:59:04.333 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:59:04.333 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:59:04.333 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.333 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.333 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.b.asok 2026-02-17T12:59:04.334 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:59:04.334 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.b.asok config get fsid 2026-02-17T12:59:04.379 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon b mon_host 2026-02-17T12:59:04.379 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T12:59:04.379 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=b 2026-02-17T12:59:04.379 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T12:59:04.379 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T12:59:04.379 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.b 2026-02-17T12:59:04.379 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2026-02-17T12:59:04.380 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2026-02-17T12:59:04.380 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T12:59:04.381 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.381 INFO:tasks.workunit.client.0.trial155.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.381 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.189587/ceph-mon.b.asok 2026-02-17T12:59:04.381 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T12:59:04.381 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.189587/ceph-mon.b.asok config get mon_host 2026-02-17T12:59:04.426 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:181: TEST_check_version_health_3: local start_osd_time=114 2026-02-17T12:59:04.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:183: TEST_check_version_health_3: EXTRA_OPTS=' --osd-objectstore=memstore' 2026-02-17T12:59:04.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:183: TEST_check_version_health_3: run_osd td/ver-health 0 2026-02-17T12:59:04.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ver-health 2026-02-17T12:59:04.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:59:04.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T12:59:04.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:59:04.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ver-health/0 2026-02-17T12:59:04.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:59:04.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:59:04.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:59:04.427 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-objectstore=memstore' 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:04.428 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:59:04.429 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ver-health/0 2026-02-17T12:59:04.430 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:59:04.430 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=13cc69bb-52ba-401e-af6e-f2cf99db7a69 2026-02-17T12:59:04.430 INFO:tasks.workunit.client.0.trial155.stdout:add osd0 13cc69bb-52ba-401e-af6e-f2cf99db7a69 2026-02-17T12:59:04.431 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 13cc69bb-52ba-401e-af6e-f2cf99db7a69' 2026-02-17T12:59:04.431 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:59:04.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAYZpRpCrwZGhAACNuzdAkEybwz/fwT3ShHOA== 2026-02-17T12:59:04.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAYZpRpCrwZGhAACNuzdAkEybwz/fwT3ShHOA=="}' 2026-02-17T12:59:04.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 13cc69bb-52ba-401e-af6e-f2cf99db7a69 -i td/ver-health/0/new.json 2026-02-17T12:59:10.543 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:59:10.550 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ver-health/0/new.json 2026-02-17T12:59:10.551 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAYZpRpCrwZGhAACNuzdAkEybwz/fwT3ShHOA== --osd-uuid 13cc69bb-52ba-401e-af6e-f2cf99db7a69 2026-02-17T12:59:10.568 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:10.567+0000 7fe6cc12c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:10.570 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:10.569+0000 7fe6cc12c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:10.571 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:10.569+0000 7fe6cc12c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:10.571 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:10.570+0000 7fe6cc12c780 -1 memstore(td/ver-health/0) td/ver-health/0 2026-02-17T12:59:10.576 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ver-health/0/keyring 2026-02-17T12:59:10.577 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:59:10.577 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T12:59:10.578 INFO:tasks.workunit.client.0.trial155.stdout:adding osd0 key to auth repository 2026-02-17T12:59:10.578 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ver-health/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:59:10.678 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T12:59:10.678 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:59:10.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:59:10.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:59:10.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:59:10.679 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:59:10.695 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:10.693+0000 7f8d7302e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:10.696 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:10.695+0000 7f8d7302e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:10.697 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:10.696+0000 7f8d7302e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:10.698 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:10.697+0000 7f8d7302e780 -1 Falling back to public interface 2026-02-17T12:59:10.704 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:10.703+0000 7f8d7302e780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:59:10.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T12:59:10.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:59:10.777 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:59:10.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:59:10.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:59:10.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:59:10.778 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:59:10.778 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:59:10.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:59:10.779 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:59:10.878 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:59:11.879 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:59:11.879 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:59:11.880 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:59:11.880 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:59:11.880 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:59:11.880 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:59:11.977 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2457259372,v1:127.0.0.1:6801/2457259372] [v2:127.0.0.1:6802/2457259372,v1:127.0.0.1:6803/2457259372] exists,up 13cc69bb-52ba-401e-af6e-f2cf99db7a69 2026-02-17T12:59:11.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:59:11.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:59:11.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:59:11.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:184: TEST_check_version_health_3: EXTRA_OPTS=' --osd-objectstore=memstore' 2026-02-17T12:59:11.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:184: TEST_check_version_health_3: run_osd td/ver-health 1 2026-02-17T12:59:11.981 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ver-health 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ver-health/1 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ver-health/1' 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ver-health/1/journal' 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:59:11.982 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-objectstore=memstore' 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:59:11.983 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:59:11.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:59:11.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:59:11.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:59:11.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:59:11.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:59:11.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:59:11.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:59:11.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ver-health/1 2026-02-17T12:59:11.984 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:59:11.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=de97fd0d-0acb-4511-985c-ab2bd2a9f427 2026-02-17T12:59:11.984 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 de97fd0d-0acb-4511-985c-ab2bd2a9f427' 2026-02-17T12:59:11.985 INFO:tasks.workunit.client.0.trial155.stdout:add osd1 de97fd0d-0acb-4511-985c-ab2bd2a9f427 2026-02-17T12:59:11.985 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:59:11.992 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAfZpRpf8oMOxAAkDgiSc81/hTWMxVegmB4Ew== 2026-02-17T12:59:11.992 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAfZpRpf8oMOxAAkDgiSc81/hTWMxVegmB4Ew=="}' 2026-02-17T12:59:11.992 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new de97fd0d-0acb-4511-985c-ab2bd2a9f427 -i td/ver-health/1/new.json 2026-02-17T12:59:12.093 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:59:12.099 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ver-health/1/new.json 2026-02-17T12:59:12.100 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAfZpRpf8oMOxAAkDgiSc81/hTWMxVegmB4Ew== --osd-uuid de97fd0d-0acb-4511-985c-ab2bd2a9f427 2026-02-17T12:59:12.118 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:12.117+0000 7f555d5f3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:12.120 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:12.118+0000 7f555d5f3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:12.121 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:12.119+0000 7f555d5f3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:12.121 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:12.120+0000 7f555d5f3780 -1 memstore(td/ver-health/1) td/ver-health/1 2026-02-17T12:59:12.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ver-health/1/keyring 2026-02-17T12:59:12.126 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:59:12.127 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T12:59:12.128 INFO:tasks.workunit.client.0.trial155.stdout:adding osd1 key to auth repository 2026-02-17T12:59:12.128 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ver-health/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:59:12.229 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T12:59:12.229 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:59:12.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:59:12.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:59:12.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:59:12.230 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:59:12.246 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:12.244+0000 7f044fa0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:12.247 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:12.246+0000 7f044fa0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:12.248 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:12.247+0000 7f044fa0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:12.249 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:12.248+0000 7f044fa0f780 -1 Falling back to public interface 2026-02-17T12:59:12.256 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:12.255+0000 7f044fa0f780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:59:12.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T12:59:12.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:59:12.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:59:12.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:59:12.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:59:12.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:59:12.325 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:59:12.325 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:59:12.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:59:12.326 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:59:12.421 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:59:13.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:59:13.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:59:13.422 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:59:13.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:59:13.422 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:59:13.423 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:59:13.519 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/2192991782,v1:127.0.0.1:6809/2192991782] [v2:127.0.0.1:6810/2192991782,v1:127.0.0.1:6811/2192991782] exists,up de97fd0d-0acb-4511-985c-ab2bd2a9f427 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:185: TEST_check_version_health_3: EXTRA_OPTS=' --osd-objectstore=memstore' 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:185: TEST_check_version_health_3: run_osd td/ver-health 2 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ver-health 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ver-health/2 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:59:13.520 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-17T12:59:13.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-17T12:59:13.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T12:59:13.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-objectstore=memstore' 2026-02-17T12:59:13.521 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:59:13.521 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T12:59:13.521 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:59:13.521 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:59:13.521 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:59:13.521 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:13.521 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:13.521 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ver-health/2 2026-02-17T12:59:13.522 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T12:59:13.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=bf19a81b-585b-4629-905f-5965a10d9410 2026-02-17T12:59:13.523 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 bf19a81b-585b-4629-905f-5965a10d9410' 2026-02-17T12:59:13.523 INFO:tasks.workunit.client.0.trial155.stdout:add osd2 bf19a81b-585b-4629-905f-5965a10d9410 2026-02-17T12:59:13.523 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T12:59:13.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAhZpRpA/3VHxAARj0V96Gwdvl7iBpff/tL4g== 2026-02-17T12:59:13.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAhZpRpA/3VHxAARj0V96Gwdvl7iBpff/tL4g=="}' 2026-02-17T12:59:13.535 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new bf19a81b-585b-4629-905f-5965a10d9410 -i td/ver-health/2/new.json 2026-02-17T12:59:13.639 INFO:tasks.workunit.client.0.trial155.stdout:2 2026-02-17T12:59:13.645 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ver-health/2/new.json 2026-02-17T12:59:13.646 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAhZpRpA/3VHxAARj0V96Gwdvl7iBpff/tL4g== --osd-uuid bf19a81b-585b-4629-905f-5965a10d9410 2026-02-17T12:59:13.665 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:13.663+0000 7fabab9f5780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:13.666 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:13.665+0000 7fabab9f5780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:13.667 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:13.666+0000 7fabab9f5780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:13.667 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:13.666+0000 7fabab9f5780 -1 memstore(td/ver-health/2) td/ver-health/2 2026-02-17T12:59:13.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ver-health/2/keyring 2026-02-17T12:59:13.672 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T12:59:13.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T12:59:13.673 INFO:tasks.workunit.client.0.trial155.stdout:adding osd2 key to auth repository 2026-02-17T12:59:13.673 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ver-health/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T12:59:13.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T12:59:13.772 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:59:13.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:59:13.772 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T12:59:13.773 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T12:59:13.773 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T12:59:13.789 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:13.788+0000 7f2c1a616780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:13.791 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:13.790+0000 7f2c1a616780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:13.792 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:13.791+0000 7f2c1a616780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:13.793 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:13.792+0000 7f2c1a616780 -1 Falling back to public interface 2026-02-17T12:59:13.801 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:13.799+0000 7f2c1a616780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:59:13.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T12:59:13.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:59:13.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:59:13.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:59:13.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:59:13.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:59:13.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:59:13.868 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:59:13.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:59:13.868 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:59:13.964 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:59:14.965 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:59:14.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:59:14.966 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:59:14.966 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:59:14.967 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:59:14.967 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:59:15.066 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/3619182083,v1:127.0.0.1:6817/3619182083] [v2:127.0.0.1:6818/3619182083,v1:127.0.0.1:6819/3619182083] exists,up bf19a81b-585b-4629-905f-5965a10d9410 2026-02-17T12:59:15.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:59:15.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:59:15.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:59:15.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:187: TEST_check_version_health_3: local warn_older_version_delay=31 2026-02-17T12:59:15.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:189: TEST_check_version_health_3: sleep 5 2026-02-17T12:59:20.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:190: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:20.160 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_OK 2026-02-17T12:59:20.166 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:192: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:20.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:192: TEST_check_version_health_3: grep DAEMON_OLD_VERSION 2026-02-17T12:59:20.267 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:193: TEST_check_version_health_3: ceph tell 'mon.*' injectargs '--mon_warn_older_version_delay 31' 2026-02-17T12:59:20.319 INFO:tasks.workunit.client.0.trial155.stdout:mon.a: {} 2026-02-17T12:59:20.326 INFO:tasks.workunit.client.0.trial155.stdout:mon.b: {} 2026-02-17T12:59:20.331 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:194: TEST_check_version_health_3: kill_daemons td/ver-health KILL osd.1 2026-02-17T12:59:20.331 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:59:20.331 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:59:20.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:59:20.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:59:20.332 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:59:20.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:59:20.440 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:195: TEST_check_version_health_3: EXTRA_OPTS=' --osd-objectstore=memstore' 2026-02-17T12:59:20.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:195: TEST_check_version_health_3: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-17T12:59:20.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:195: TEST_check_version_health_3: activate_osd td/ver-health 1 2026-02-17T12:59:20.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ver-health 2026-02-17T12:59:20.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:59:20.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T12:59:20.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:59:20.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ver-health/1 2026-02-17T12:59:20.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:59:20.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:59:20.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:59:20.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ver-health/1' 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ver-health/1/journal' 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-objectstore=memstore' 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:20.442 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ver-health/1 2026-02-17T12:59:20.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T12:59:20.444 INFO:tasks.workunit.client.0.trial155.stdout:start osd.1 2026-02-17T12:59:20.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/1 --osd-journal=td/ver-health/1/journal --chdir= --osd-objectstore=memstore --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:59:20.445 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ver-health/1/whoami 2026-02-17T12:59:20.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T12:59:20.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:59:20.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:59:20.445 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:59:20.456 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:20.455+0000 7ff7a1bb2780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:20.458 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:20.456+0000 7ff7a1bb2780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:20.459 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:20.457+0000 7ff7a1bb2780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:20.460 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:20.459+0000 7ff7a1bb2780 -1 Falling back to public interface 2026-02-17T12:59:20.466 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:20.465+0000 7ff7a1bb2780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:59:20.540 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T12:59:20.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:59:20.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T12:59:20.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:59:20.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:59:20.541 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:59:20.541 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:59:20.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:59:20.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:59:20.542 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T12:59:20.640 INFO:tasks.workunit.client.0.trial155.stdout:osd.1 up in weight 1 up_from 19 up_thru 0 down_at 17 last_clean_interval [0,0) [v2:127.0.0.1:6808/1149769336,v1:127.0.0.1:6809/1149769336] [v2:127.0.0.1:6810/1149769336,v1:127.0.0.1:6811/1149769336] exists,up de97fd0d-0acb-4511-985c-ab2bd2a9f427 2026-02-17T12:59:20.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:59:20.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:59:20.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:59:20.641 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:200: TEST_check_version_health_3: sleep 10 2026-02-17T12:59:30.642 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:202: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:30.642 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:202: TEST_check_version_health_3: grep DAEMON_OLD_VERSION 2026-02-17T12:59:30.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:205: TEST_check_version_health_3: wait_for_health_string 'HEALTH_WARN .*There is a daemon running an older version of ceph' 20 2026-02-17T12:59:30.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:30.743 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-17T12:59:30.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-17T12:59:30.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-17T12:59:30.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-17T12:59:30.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:30.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:30.744 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:30.839 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:31.840 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:31.841 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:31.841 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:31.841 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:31.940 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:32.941 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:32.942 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:32.942 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:32.942 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:33.042 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:34.043 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:34.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:34.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:34.044 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:34.141 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:35.143 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:35.143 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:35.143 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:35.144 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:35.241 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:36.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:36.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:36.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:36.243 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:36.342 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:37.343 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:37.343 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:37.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:37.344 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:37.441 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:38.442 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:38.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:38.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:38.443 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:38.544 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:39.545 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:39.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:39.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:39.546 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:39.646 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:40.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:40.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:40.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:40.648 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:40.745 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:41.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:41.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:41.747 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:41.748 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:41.847 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:42.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:42.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:42.849 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:42.850 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:42.950 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:43.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:43.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:43.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:43.952 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:44.056 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:45.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:45.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:45.057 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:45.058 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:45.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-17T12:59:45.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-17T12:59:45.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-17T12:59:45.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-17T12:59:45.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-17T12:59:45.156 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:207: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:45.250 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN There is a daemon running an older version of ceph 2026-02-17T12:59:45.250 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] DAEMON_OLD_VERSION: There is a daemon running an older version of ceph 2026-02-17T12:59:45.250 INFO:tasks.workunit.client.0.trial155.stdout: osd.1 is running an older version of ceph: 01.00.00-gversion-test 2026-02-17T12:59:45.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:209: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:45.256 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:209: TEST_check_version_health_3: grep -q 'HEALTH_WARN .*There is a daemon running an older version of ceph' 2026-02-17T12:59:45.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:210: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:45.355 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:210: TEST_check_version_health_3: grep -q '^[[]WRN[]] DAEMON_OLD_VERSION: There is a daemon running an older version of ceph' 2026-02-17T12:59:45.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:211: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:45.454 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:211: TEST_check_version_health_3: grep -q 'osd.1 is running an older version of ceph: 01.00.00-gversion-test' 2026-02-17T12:59:45.552 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:213: TEST_check_version_health_3: kill_daemons td/ver-health KILL osd.2 2026-02-17T12:59:45.553 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:59:45.553 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:59:45.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:59:45.553 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:59:45.554 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:59:45.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:59:45.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:214: TEST_check_version_health_3: ceph_debug_version_for_testing=01.00.00-gversion-test 2026-02-17T12:59:45.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:214: TEST_check_version_health_3: activate_osd td/ver-health 2 2026-02-17T12:59:45.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ver-health 2026-02-17T12:59:45.661 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ver-health/2 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ver-health/2' 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ver-health/2/journal' 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:59:45.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:59:45.663 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:59:45.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:59:45.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:59:45.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:59:45.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:59:45.664 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ver-health/2 2026-02-17T12:59:45.664 INFO:tasks.workunit.client.0.trial155.stdout:start osd.2 2026-02-17T12:59:45.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T12:59:45.665 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/2 --osd-journal=td/ver-health/2/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:59:45.666 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ver-health/2/whoami 2026-02-17T12:59:45.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T12:59:45.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:59:45.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:59:45.666 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:59:45.678 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:45.677+0000 7fc658d95780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:45.679 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:45.678+0000 7fc658d95780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:45.680 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:45.679+0000 7fc658d95780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:45.682 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:45.680+0000 7fc658d95780 -1 Falling back to public interface 2026-02-17T12:59:45.690 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:45.688+0000 7fc658d95780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:59:45.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T12:59:45.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:59:45.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T12:59:45.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:59:45.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:59:45.763 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:59:45.763 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:59:45.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:59:45.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:59:45.764 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:59:45.858 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:59:46.859 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:59:46.859 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:59:46.860 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:59:46.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:59:46.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:59:46.861 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T12:59:46.955 INFO:tasks.workunit.client.0.trial155.stdout:osd.2 up in weight 1 up_from 23 up_thru 0 down_at 21 last_clean_interval [0,0) [v2:127.0.0.1:6816/2991004526,v1:127.0.0.1:6817/2991004526] [v2:127.0.0.1:6818/2991004526,v1:127.0.0.1:6819/2991004526] exists,up bf19a81b-585b-4629-905f-5965a10d9410 2026-02-17T12:59:46.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:59:46.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:59:46.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:59:46.956 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:215: TEST_check_version_health_3: kill_daemons td/ver-health KILL osd.0 2026-02-17T12:59:46.956 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:59:46.956 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:59:46.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:59:46.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:59:46.957 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:59:47.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:59:47.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:216: TEST_check_version_health_3: ceph_debug_version_for_testing=02.00.00-gversion-test 2026-02-17T12:59:47.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:216: TEST_check_version_health_3: activate_osd td/ver-health 0 2026-02-17T12:59:47.064 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ver-health 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ver-health/0 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 ' 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ver-health/0' 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ver-health/0/journal' 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T12:59:47.065 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ver-health' 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ver-health/$name.log' 2026-02-17T12:59:47.066 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ver-health/$name.pid' 2026-02-17T12:59:47.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T12:59:47.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T12:59:47.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T12:59:47.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T12:59:47.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T12:59:47.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T12:59:47.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ver-health/0 2026-02-17T12:59:47.067 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T12:59:47.068 INFO:tasks.workunit.client.0.trial155.stdout:start osd.0 2026-02-17T12:59:47.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=d7f75512-b6b8-44a0-8353-0ae12625ae26 --auth-supported=none --mon-host= --mon_health_to_clog_tick_interval=1.0 --mon-host=127.0.0.1:7165 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ver-health/0 --osd-journal=td/ver-health/0/journal --chdir= --run-dir=td/ver-health '--admin-socket=/tmp/ceph-asok.189587/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ver-health/$name.log' '--pid-file=td/ver-health/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T12:59:47.069 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ver-health/0/whoami 2026-02-17T12:59:47.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T12:59:47.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T12:59:47.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T12:59:47.069 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T12:59:47.082 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:47.081+0000 7f230c7a3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:47.083 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:47.082+0000 7f230c7a3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:47.085 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:47.083+0000 7f230c7a3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T12:59:47.086 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:47.084+0000 7f230c7a3780 -1 Falling back to public interface 2026-02-17T12:59:47.091 INFO:tasks.workunit.client.0.trial155.stderr:2026-02-17T12:59:47.090+0000 7f230c7a3780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:59:47.162 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T12:59:47.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T12:59:47.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T12:59:47.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T12:59:47.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T12:59:47.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:59:47.163 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T12:59:47.164 INFO:tasks.workunit.client.0.trial155.stdout:0 2026-02-17T12:59:47.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:59:47.164 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:59:47.259 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T12:59:48.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T12:59:48.260 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T12:59:48.261 INFO:tasks.workunit.client.0.trial155.stdout:1 2026-02-17T12:59:48.261 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T12:59:48.262 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T12:59:48.262 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T12:59:48.360 INFO:tasks.workunit.client.0.trial155.stdout:osd.0 up in weight 1 up_from 27 up_thru 0 down_at 25 last_clean_interval [0,0) [v2:127.0.0.1:6800/250332471,v1:127.0.0.1:6801/250332471] [v2:127.0.0.1:6802/250332471,v1:127.0.0.1:6803/250332471] exists,up 13cc69bb-52ba-401e-af6e-f2cf99db7a69 2026-02-17T12:59:48.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T12:59:48.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T12:59:48.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T12:59:48.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:218: TEST_check_version_health_3: wait_for_health_string 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:59:48.361 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:40: wait_for_health_string: local 'grep_string=HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:59:48.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:41: wait_for_health_string: local seconds=20 2026-02-17T12:59:48.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:44: wait_for_health_string: set -o pipefail 2026-02-17T12:59:48.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:45: wait_for_health_string: PASSED=false 2026-02-17T12:59:48.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i=0 )) 2026-02-17T12:59:48.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:48.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:48.362 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:59:48.458 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:52: wait_for_health_string: sleep 1 2026-02-17T12:59:49.459 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i++ )) 2026-02-17T12:59:49.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:46: wait_for_health_string: (( i < 20 )) 2026-02-17T12:59:49.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: ceph health 2026-02-17T12:59:49.460 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:47: wait_for_health_string: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:59:49.561 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:49: wait_for_health_string: PASSED=true 2026-02-17T12:59:49.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:50: wait_for_health_string: break 2026-02-17T12:59:49.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:54: wait_for_health_string: set +o pipefail 2026-02-17T12:59:49.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:57: wait_for_health_string: '[' true = false ']' 2026-02-17T12:59:49.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:61: wait_for_health_string: return 0 2026-02-17T12:59:49.562 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:220: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:49.656 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_ERR There are daemons running multiple old versions of ceph 2026-02-17T12:59:49.656 INFO:tasks.workunit.client.0.trial155.stdout:[ERR] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph 2026-02-17T12:59:49.656 INFO:tasks.workunit.client.0.trial155.stdout: osd.1 osd.2 are running an older version of ceph: 01.00.00-gversion-test 2026-02-17T12:59:49.656 INFO:tasks.workunit.client.0.trial155.stdout: osd.0 is running an older version of ceph: 02.00.00-gversion-test 2026-02-17T12:59:49.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:221: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:49.662 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:221: TEST_check_version_health_3: grep -q 'HEALTH_ERR .*There are daemons running multiple old versions of ceph' 2026-02-17T12:59:49.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:222: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:49.762 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:222: TEST_check_version_health_3: grep -q '^[[]ERR[]] DAEMON_OLD_VERSION: There are daemons running multiple old versions of ceph' 2026-02-17T12:59:49.862 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:223: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:49.862 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:223: TEST_check_version_health_3: grep -q 'osd.1 osd.2 are running an older version of ceph: 01.00.00-gversion-test' 2026-02-17T12:59:49.962 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:224: TEST_check_version_health_3: ceph health detail 2026-02-17T12:59:49.962 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:224: TEST_check_version_health_3: grep -q 'osd.0 is running an older version of ceph: 02.00.00-gversion-test' 2026-02-17T12:59:50.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh:35: run: teardown td/ver-health 2026-02-17T12:59:50.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ver-health 2026-02-17T12:59:50.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T12:59:50.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ver-health KILL 2026-02-17T12:59:50.060 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:59:50.060 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:59:50.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:59:50.060 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:59:50.061 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:59:50.167 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:59:50.167 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:59:50.168 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:59:50.169 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:59:50.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:59:50.170 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:59:50.170 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:59:50.171 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:59:50.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:59:50.172 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:59:50.172 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:59:50.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:59:50.173 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T12:59:50.174 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ver-health 2026-02-17T12:59:50.179 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:59:50.179 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:50.179 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:50.179 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.189587 2026-02-17T12:59:50.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:59:50.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:59:50.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T12:59:50.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/ver-health 0 2026-02-17T12:59:50.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ver-health 2026-02-17T12:59:50.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T12:59:50.181 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ver-health KILL 2026-02-17T12:59:50.182 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T12:59:50.182 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T12:59:50.182 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T12:59:50.182 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T12:59:50.182 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T12:59:50.182 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T12:59:50.183 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T12:59:50.183 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T12:59:50.184 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T12:59:50.184 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T12:59:50.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T12:59:50.185 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T12:59:50.185 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:59:50.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T12:59:50.186 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T12:59:50.186 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:59:50.187 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:59:50.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T12:59:50.188 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ver-health 2026-02-17T12:59:50.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T12:59:50.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T12:59:50.189 INFO:tasks.workunit.client.0.trial155.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.189587 2026-02-17T12:59:50.189 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.189587 2026-02-17T12:59:50.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T12:59:50.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T12:59:50.191 INFO:tasks.workunit.client.0.trial155.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T12:59:50.191 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T12:59:50.191 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T12:59:50.256 INFO:tasks.workunit:Stopping ['misc'] on client.0... 2026-02-17T12:59:50.256 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T12:59:50.602 DEBUG:teuthology.parallel:result is None 2026-02-17T12:59:50.602 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T12:59:50.627 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T12:59:50.628 DEBUG:teuthology.orchestra.run.trial155:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T12:59:50.686 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T12:59:50.686 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T12:59:50.700 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T12:59:50.701 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:59:50.851 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T12:59:50.862 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T12:59:50.862 DEBUG:teuthology.orchestra.run.trial155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:59:50.878 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-17T13:00:30.922 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T13:00:30.922 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-17T13:00:30.922 INFO:teuthology.orchestra.run.trial155.stdout:^- 45.63.54.13 2 8 377 78 +94us[ +211us] +/- 38ms 2026-02-17T13:00:30.922 INFO:teuthology.orchestra.run.trial155.stdout:^- 172.238.164.57 4 8 377 217 -4562us[-4452us] +/- 33ms 2026-02-17T13:00:30.922 INFO:teuthology.orchestra.run.trial155.stdout:^* 23.159.16.194 2 8 377 96 -38us[ +79us] +/- 7745us 2026-02-17T13:00:30.923 INFO:teuthology.orchestra.run.trial155.stdout:^- 207.58.172.126 3 8 377 112 -144us[ -27us] +/- 30ms 2026-02-17T13:00:30.923 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T13:00:30.933 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T13:00:30.933 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T13:00:30.948 DEBUG:teuthology.orchestra.run.trial155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T13:00:31.017 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T13:00:31.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T13:00:31.043 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T13:00:31.059 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T13:00:31.073 INFO:teuthology.task.internal:Duration was 2677.101388 seconds 2026-02-17T13:00:31.073 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T13:00:31.095 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T13:00:31.096 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T13:00:31.134 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T13:00:31.463 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T13:00:31.463 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial155.front.sepia.ceph.com 2026-02-17T13:00:31.464 DEBUG:teuthology.orchestra.run.trial155:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T13:00:31.524 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T13:00:31.524 DEBUG:teuthology.orchestra.run.trial155:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T13:00:31.623 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T13:00:31.623 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T13:00:31.645 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T13:00:31.646 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T13:00:31.646 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T13:00:31.647 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T13:00:31.647 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T13:00:31.655 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T13:00:31.657 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T13:00:31.673 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T13:00:31.673 DEBUG:teuthology.orchestra.run.trial155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T13:00:31.721 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T13:00:31.738 DEBUG:teuthology.orchestra.run.trial155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T13:00:31.785 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = core 2026-02-17T13:00:31.797 DEBUG:teuthology.orchestra.run.trial155:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T13:00:31.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T13:00:31.853 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T13:00:31.869 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T13:00:31.871 DEBUG:teuthology.misc:Transferring archived files from trial155:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51436/remote/trial155 2026-02-17T13:00:31.872 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T13:00:31.931 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T13:00:31.932 DEBUG:teuthology.orchestra.run.trial155:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T13:00:31.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T13:00:31.996 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T13:00:31.996 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T13:00:32.012 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T13:00:32.012 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T13:00:32.036 INFO:teuthology.orchestra.run.trial155.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 13:00 /home/ubuntu/cephtest 2026-02-17T13:00:32.037 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T13:00:32.054 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T13:00:32.090 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc} duration: 2677.1013884544373 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T13:00:32.091 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T13:00:32.210 INFO:teuthology.run:pass