2026-02-17T08:21:02.777 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T08:21:02.793 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:21:02.869 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51132 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/mgr} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51132' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIC0jovg5LM/BffS8qVaylFYgGB3K7m9h9uTDMXi1EoyqhBwoFL9VwObS3mcwLWKZaJ3ru3qKE8TiKflWG2opa0= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - mgr teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:03:08 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T08:21:02.869 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-17T08:21:02.869 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-17T08:21:02.869 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T08:21:02.871 INFO:teuthology.task.internal:Checking packages... 2026-02-17T08:21:02.871 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-17T08:21:02.871 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T08:21:02.871 INFO:teuthology.packaging:ref: None 2026-02-17T08:21:02.871 INFO:teuthology.packaging:tag: None 2026-02-17T08:21:02.871 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:21:02.871 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:21:02.871 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:21:02.993 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705.g04cf6dd4 2026-02-17T08:21:02.993 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T08:21:03.006 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T08:21:03.006 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T08:21:03.020 INFO:teuthology.task.internal:Saving configuration 2026-02-17T08:21:03.028 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T08:21:03.040 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T08:21:03.118 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial072.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51132', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 08:17:36.336824', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIC0jovg5LM/BffS8qVaylFYgGB3K7m9h9uTDMXi1EoyqhBwoFL9VwObS3mcwLWKZaJ3ru3qKE8TiKflWG2opa0='} 2026-02-17T08:21:03.118 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T08:21:03.129 INFO:teuthology.task.internal:roles: ubuntu@trial072.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T08:21:03.130 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T08:21:03.215 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x75495fdc6840>, signals=[15]) 2026-02-17T08:21:03.215 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T08:21:03.227 INFO:teuthology.task.internal:Opening connections... 2026-02-17T08:21:03.227 DEBUG:teuthology.task.internal:connecting to ubuntu@trial072.front.sepia.ceph.com 2026-02-17T08:21:03.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:21:03.289 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T08:21:03.300 DEBUG:teuthology.orchestra.run.trial072:> uname -m 2026-02-17T08:21:03.362 INFO:teuthology.orchestra.run.trial072.stdout:x86_64 2026-02-17T08:21:03.362 DEBUG:teuthology.orchestra.run.trial072:> cat /etc/os-release 2026-02-17T08:21:03.418 INFO:teuthology.orchestra.run.trial072.stdout:NAME="CentOS Stream" 2026-02-17T08:21:03.418 INFO:teuthology.orchestra.run.trial072.stdout:VERSION="9" 2026-02-17T08:21:03.418 INFO:teuthology.orchestra.run.trial072.stdout:ID="centos" 2026-02-17T08:21:03.418 INFO:teuthology.orchestra.run.trial072.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:21:03.418 INFO:teuthology.orchestra.run.trial072.stdout:VERSION_ID="9" 2026-02-17T08:21:03.418 INFO:teuthology.orchestra.run.trial072.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:21:03.419 INFO:teuthology.orchestra.run.trial072.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:21:03.419 INFO:teuthology.orchestra.run.trial072.stdout:ANSI_COLOR="0;31" 2026-02-17T08:21:03.419 INFO:teuthology.orchestra.run.trial072.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:21:03.419 INFO:teuthology.orchestra.run.trial072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:21:03.419 INFO:teuthology.orchestra.run.trial072.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:21:03.419 INFO:teuthology.orchestra.run.trial072.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:21:03.419 INFO:teuthology.orchestra.run.trial072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:21:03.419 INFO:teuthology.orchestra.run.trial072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:21:03.420 INFO:teuthology.lock.ops:Updating trial072.front.sepia.ceph.com on lock server 2026-02-17T08:21:03.509 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T08:21:03.524 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T08:21:03.537 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T08:21:03.537 DEBUG:teuthology.orchestra.run.trial072:> test '!' -e /home/ubuntu/cephtest 2026-02-17T08:21:03.552 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T08:21:03.564 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T08:21:03.565 DEBUG:teuthology.orchestra.run.trial072:> test -z $(ls -A /var/lib/ceph) 2026-02-17T08:21:03.609 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T08:21:03.720 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T08:21:03.740 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T08:21:03.740 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T08:21:03.741 DEBUG:teuthology.orchestra.run.trial072:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T08:21:03.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:21:03.755 DEBUG:teuthology.orchestra.run.trial072:> uname -r 2026-02-17T08:21:03.811 INFO:teuthology.orchestra.run.trial072.stdout:5.14.0-645.el9.x86_64 2026-02-17T08:21:03.811 INFO:teuthology.task.kernel:Running kernel on trial072: 5.14.0-645.el9.x86_64 2026-02-17T08:21:03.811 DEBUG:teuthology.orchestra.run.trial072:> sudo yum install -y kernel 2026-02-17T08:21:04.968 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-17T08:21:08.124 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T08:21:11.988 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 7.8 MB 00:01 2026-02-17T08:21:13.759 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 20 kB 00:01 2026-02-17T08:21:14.266 INFO:teuthology.orchestra.run.trial072.stdout:Extra Packages for Enterprise Linux 46 MB/s | 20 MB 00:00 2026-02-17T08:21:17.468 INFO:teuthology.orchestra.run.trial072.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-17T08:21:18.478 INFO:teuthology.orchestra.run.trial072.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T08:21:18.498 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:21:18.499 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:21:18.500 INFO:teuthology.orchestra.run.trial072.stdout: Package Architecture Version Repository Size 2026-02-17T08:21:18.500 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:21:18.500 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-17T08:21:18.500 INFO:teuthology.orchestra.run.trial072.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T08:21:18.500 INFO:teuthology.orchestra.run.trial072.stdout:Installing dependencies: 2026-02-17T08:21:18.500 INFO:teuthology.orchestra.run.trial072.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T08:21:18.500 INFO:teuthology.orchestra.run.trial072.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T08:21:18.500 INFO:teuthology.orchestra.run.trial072.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T08:21:18.501 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:21:18.501 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-17T08:21:18.501 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:21:18.501 INFO:teuthology.orchestra.run.trial072.stdout:Install 4 Packages 2026-02-17T08:21:18.501 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:21:18.501 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 88 M 2026-02-17T08:21:18.501 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 135 M 2026-02-17T08:21:18.501 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-17T08:21:19.620 INFO:teuthology.orchestra.run.trial072.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 757 kB/s | 803 kB 00:01 2026-02-17T08:21:20.650 INFO:teuthology.orchestra.run.trial072.stdout:(2/4): kernel-modules-core-5.14.0-681.el9.x86_6 30 MB/s | 31 MB 00:01 2026-02-17T08:21:21.006 INFO:teuthology.orchestra.run.trial072.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 16 MB/s | 40 MB 00:02 2026-02-17T08:21:25.869 INFO:teuthology.orchestra.run.trial072.stdout:(4/4): kernel-core-5.14.0-681.el9.x86_64.rpm 2.3 MB/s | 17 MB 00:07 2026-02-17T08:21:25.871 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:25.871 INFO:teuthology.orchestra.run.trial072.stdout:Total 12 MB/s | 88 MB 00:07 2026-02-17T08:21:26.059 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-17T08:21:26.268 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-17T08:21:26.268 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-17T08:21:26.615 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-17T08:21:26.615 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-17T08:21:27.693 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-17T08:21:27.976 INFO:teuthology.orchestra.run.trial072.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T08:21:27.995 INFO:teuthology.orchestra.run.trial072.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T08:21:29.785 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T08:21:29.814 INFO:teuthology.orchestra.run.trial072.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T08:21:33.031 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T08:21:33.037 INFO:teuthology.orchestra.run.trial072.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:21:36.129 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:22:06.497 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:22:06.518 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:22:06.581 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:22:06.581 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T08:22:06.582 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T08:22:06.582 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T08:22:06.634 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:22:06.634 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:22:06.634 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-17T08:22:06.634 INFO:teuthology.orchestra.run.trial072.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T08:22:06.634 INFO:teuthology.orchestra.run.trial072.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T08:22:06.634 INFO:teuthology.orchestra.run.trial072.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T08:22:06.634 INFO:teuthology.orchestra.run.trial072.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T08:22:06.634 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:22:06.635 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:22:06.692 DEBUG:teuthology.orchestra.run.trial072:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T08:22:06.717 INFO:teuthology.orchestra.run.trial072.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T08:22:06.718 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T08:22:06.718 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T08:22:06.718 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T08:22:06.718 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T08:22:06.719 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T08:22:06.719 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial072.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T08:22:06.719 DEBUG:teuthology.orchestra.run.trial072:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T08:22:06.781 INFO:teuthology.orchestra.run.trial072.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T08:22:06.782 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T08:22:06.783 DEBUG:teuthology.orchestra.run.trial072:> sudo rpm -qi grub2-tools 2026-02-17T08:22:06.851 INFO:teuthology.orchestra.run.trial072.stdout:Name : grub2-tools 2026-02-17T08:22:06.851 INFO:teuthology.orchestra.run.trial072.stdout:Epoch : 1 2026-02-17T08:22:06.851 INFO:teuthology.orchestra.run.trial072.stdout:Version : 2.06 2026-02-17T08:22:06.851 INFO:teuthology.orchestra.run.trial072.stdout:Release : 118.el9 2026-02-17T08:22:06.851 INFO:teuthology.orchestra.run.trial072.stdout:Architecture: x86_64 2026-02-17T08:22:06.851 INFO:teuthology.orchestra.run.trial072.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T08:22:06.851 INFO:teuthology.orchestra.run.trial072.stdout:Group : Unspecified 2026-02-17T08:22:06.851 INFO:teuthology.orchestra.run.trial072.stdout:Size : 8393909 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout:License : GPLv3+ 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout:Packager : builder@centos.org 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout:Vendor : CentOS 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout:Summary : Support tools for GRUB. 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout:Description : 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:22:06.852 INFO:teuthology.orchestra.run.trial072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T08:22:06.853 INFO:teuthology.orchestra.run.trial072.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T08:22:06.853 INFO:teuthology.orchestra.run.trial072.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T08:22:06.853 INFO:teuthology.orchestra.run.trial072.stdout:hardware devices. 2026-02-17T08:22:06.853 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:22:06.853 INFO:teuthology.orchestra.run.trial072.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T08:22:06.854 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T08:22:06.854 INFO:teuthology.task.kernel:Updating grub on trial072 to boot 5.14.0-681.el9.x86_64 2026-02-17T08:22:06.854 DEBUG:teuthology.orchestra.run.trial072:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T08:22:06.917 INFO:teuthology.orchestra.run.trial072.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T08:22:06.919 DEBUG:teuthology.orchestra.run.trial072:> sudo command -v grubby && echo yes || echo no 2026-02-17T08:22:06.982 INFO:teuthology.orchestra.run.trial072.stdout:/sbin/grubby 2026-02-17T08:22:06.984 INFO:teuthology.orchestra.run.trial072.stdout:yes 2026-02-17T08:22:06.984 DEBUG:teuthology.orchestra.run.trial072:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T08:22:07.048 INFO:teuthology.orchestra.run.trial072.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T08:22:07.049 DEBUG:teuthology.orchestra.run.trial072:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T08:22:07.122 DEBUG:teuthology.orchestra.run.trial072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T08:22:07.328 INFO:teuthology.orchestra.run.trial072.stderr:Generating grub configuration file ... 2026-02-17T08:22:07.391 INFO:teuthology.orchestra.run.trial072.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T08:22:07.397 INFO:teuthology.orchestra.run.trial072.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T08:22:07.646 INFO:teuthology.orchestra.run.trial072.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T08:22:07.652 INFO:teuthology.orchestra.run.trial072.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T08:22:07.682 INFO:teuthology.orchestra.run.trial072.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T08:22:07.689 INFO:teuthology.orchestra.run.trial072.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T08:22:07.712 INFO:teuthology.orchestra.run.trial072.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T08:22:07.718 INFO:teuthology.orchestra.run.trial072.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T08:22:07.801 INFO:teuthology.orchestra.run.trial072.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T08:22:07.809 INFO:teuthology.orchestra.run.trial072.stderr:done 2026-02-17T08:22:07.811 DEBUG:teuthology.orchestra.run.trial072:> test -d /sys/firmware/efi 2026-02-17T08:22:07.827 DEBUG:teuthology.orchestra.run.trial072:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T08:22:07.891 INFO:teuthology.orchestra.run.trial072.stdout:/boot/efi/EFI/BOOT 2026-02-17T08:22:07.891 INFO:teuthology.orchestra.run.trial072.stdout:/boot/efi/EFI/centos 2026-02-17T08:22:07.893 DEBUG:teuthology.orchestra.run.trial072:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T08:22:07.959 INFO:teuthology.orchestra.run.trial072.stdout:no 2026-02-17T08:22:07.959 DEBUG:teuthology.orchestra.run.trial072:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T08:22:08.024 INFO:teuthology.orchestra.run.trial072.stdout:yes 2026-02-17T08:22:08.024 DEBUG:teuthology.orchestra.run.trial072:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T08:22:08.088 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial072 2026-02-17T08:22:08.088 DEBUG:teuthology.orchestra.run.trial072:> sudo bash -c ' 2026-02-17T08:22:08.088 DEBUG:teuthology.orchestra.run.trial072:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T08:22:08.088 DEBUG:teuthology.orchestra.run.trial072:> ' 2026-02-17T08:22:38.132 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T08:22:38.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial072.front.sepia.ceph.com' 2026-02-17T08:22:38.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:22:52.417 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.72 2026-02-17T08:23:01.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial072.front.sepia.ceph.com' 2026-02-17T08:23:01.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:23:37.203 DEBUG:teuthology.orchestra.run.trial072:> true 2026-02-17T08:23:37.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial072.front.sepia.ceph.com' 2026-02-17T08:23:37.352 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T08:23:37.352 DEBUG:teuthology.orchestra.run.trial072:> uname -r 2026-02-17T08:23:37.407 INFO:teuthology.orchestra.run.trial072.stdout:5.14.0-681.el9.x86_64 2026-02-17T08:23:37.408 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T08:23:37.408 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T08:23:37.408 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T08:23:38.408 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T08:23:38.408 DEBUG:teuthology.orchestra.run.trial072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T08:23:38.438 INFO:teuthology.orchestra.run.trial072.stdout:ttyS1 2026-02-17T08:23:38.458 DEBUG:teuthology.parallel:result is None 2026-02-17T08:23:38.458 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T08:23:38.468 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T08:23:38.469 DEBUG:teuthology.orchestra.run.trial072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T08:23:38.513 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T08:23:38.525 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T08:23:38.537 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T08:23:38.537 DEBUG:teuthology.orchestra.run.trial072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T08:23:38.577 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T08:23:38.590 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T08:23:38.591 DEBUG:teuthology.orchestra.run.trial072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T08:23:38.637 INFO:teuthology.orchestra.run.trial072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:23:38.646 INFO:teuthology.orchestra.run.trial072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:23:38.648 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T08:23:38.660 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T08:23:38.660 DEBUG:teuthology.orchestra.run.trial072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T08:23:38.713 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T08:23:38.729 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T08:23:38.730 DEBUG:teuthology.orchestra.run.trial072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T08:23:38.770 DEBUG:teuthology.orchestra.run.trial072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:23:38.935 DEBUG:teuthology.orchestra.run.trial072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:23:38.960 DEBUG:teuthology.orchestra.run.trial072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:23:39.109 DEBUG:teuthology.orchestra.run.trial072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:23:39.133 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-17T08:23:39.133 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T08:23:39.197 DEBUG:teuthology.orchestra.run.trial072:> sudo service rsyslog restart 2026-02-17T08:23:39.265 INFO:teuthology.orchestra.run.trial072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T08:23:39.434 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T08:23:39.446 INFO:teuthology.task.internal:Starting timer... 2026-02-17T08:23:39.447 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T08:23:39.469 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T08:23:39.487 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T08:23:39.487 DEBUG:teuthology.orchestra.run.trial072:> sudo service auditd rotate 2026-02-17T08:23:39.517 INFO:teuthology.orchestra.run.trial072.stdout:Rotating logs: 2026-02-17T08:23:39.519 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T08:23:39.519 DEBUG:teuthology.orchestra.run.trial072:> /usr/sbin/getenforce 2026-02-17T08:23:39.575 INFO:teuthology.orchestra.run.trial072.stdout:Permissive 2026-02-17T08:23:39.575 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial072.front.sepia.ceph.com': 'permissive'} 2026-02-17T08:23:39.575 DEBUG:teuthology.orchestra.run.trial072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T08:23:39.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:23:39.640 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T08:23:39.640 DEBUG:teuthology.orchestra.run.trial072:> sudo /usr/sbin/setenforce permissive 2026-02-17T08:23:39.706 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T08:23:39.721 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T08:23:39.734 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T08:23:39.735 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial072.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T08:26:33.181 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial072.front.sepia.ceph.com')] 2026-02-17T08:26:33.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial072.front.sepia.ceph.com' 2026-02-17T08:26:33.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:26:33.251 DEBUG:teuthology.orchestra.run.trial072:> true 2026-02-17T08:26:33.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial072.front.sepia.ceph.com' 2026-02-17T08:26:33.324 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T08:26:33.337 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T08:26:33.337 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T08:26:33.338 DEBUG:teuthology.orchestra.run.trial072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:26:33.392 INFO:teuthology.orchestra.run.trial072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T08:26:33.403 INFO:teuthology.orchestra.run.trial072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T08:26:33.423 INFO:teuthology.orchestra.run.trial072.stderr:sudo: ntpd: command not found 2026-02-17T08:26:33.432 INFO:teuthology.orchestra.run.trial072.stdout:506 Cannot talk to daemon 2026-02-17T08:26:33.443 INFO:teuthology.orchestra.run.trial072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T08:26:33.455 INFO:teuthology.orchestra.run.trial072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T08:26:33.502 INFO:teuthology.orchestra.run.trial072.stderr:bash: line 1: ntpq: command not found 2026-02-17T08:26:33.503 INFO:teuthology.orchestra.run.trial072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T08:26:33.504 INFO:teuthology.orchestra.run.trial072.stdout:=============================================================================== 2026-02-17T08:26:33.505 INFO:teuthology.run_tasks:Running task install... 2026-02-17T08:26:33.520 DEBUG:teuthology.task.install:project ceph 2026-02-17T08:26:33.521 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-17T08:26:33.521 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T08:26:33.521 INFO:teuthology.task.install:Using flavor: default 2026-02-17T08:26:33.530 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T08:26:33.530 INFO:teuthology.task.install:extra packages: [] 2026-02-17T08:26:33.531 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'tag': None, 'wait_for_package': False} 2026-02-17T08:26:33.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:26:33.715 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/ 2026-02-17T08:26:33.715 INFO:teuthology.task.install.rpm:Package version is 19.2.3-705.g04cf6dd4 2026-02-17T08:26:33.974 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T08:26:33.974 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-17T08:26:33.974 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T08:26:34.000 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T08:26:34.000 DEBUG:teuthology.orchestra.run.trial072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T08:26:34.066 DEBUG:teuthology.orchestra.run.trial072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T08:26:34.140 DEBUG:teuthology.orchestra.run.trial072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T08:26:34.204 INFO:teuthology.orchestra.run.trial072.stdout:check_obsoletes = 1 2026-02-17T08:26:34.206 DEBUG:teuthology.orchestra.run.trial072:> sudo yum clean all 2026-02-17T08:26:34.355 INFO:teuthology.orchestra.run.trial072.stdout:41 files removed 2026-02-17T08:26:34.370 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-radosgw 2026-02-17T08:26:34.876 INFO:teuthology.orchestra.run.trial072.stdout:ceph packages for x86_64 239 kB/s | 86 kB 00:00 2026-02-17T08:26:35.130 INFO:teuthology.orchestra.run.trial072.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2026-02-17T08:26:35.400 INFO:teuthology.orchestra.run.trial072.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2026-02-17T08:26:36.345 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.9 MB 00:00 2026-02-17T08:26:39.345 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T08:26:43.262 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-17T08:26:44.199 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 20 kB 00:00 2026-02-17T08:26:45.065 INFO:teuthology.orchestra.run.trial072.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2026-02-17T08:26:48.243 INFO:teuthology.orchestra.run.trial072.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-17T08:26:49.470 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repository Size 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout: ceph-radosgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout:Upgrading: 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout: librados2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.4 M 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout: librbd1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.2 M 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout:Installing dependencies: 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout: ceph-base x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.5 M 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout: ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 22 M 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout: ceph-selinux x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 25 k 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T08:26:49.472 INFO:teuthology.orchestra.run.trial072.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.0 M 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: libradosstriper1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 503 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: librgw2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.4 M 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: python3-ceph-argparse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 45 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: python3-ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 154 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: python3-cephfs x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 165 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: python3-rados x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 323 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: python3-rbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 303 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: python3-rgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 100 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout:Installing weak dependencies: 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-17T08:26:49.473 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:26:49.474 INFO:teuthology.orchestra.run.trial072.stdout:Install 33 Packages 2026-02-17T08:26:49.474 INFO:teuthology.orchestra.run.trial072.stdout:Upgrade 2 Packages 2026-02-17T08:26:49.474 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:26:49.474 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 63 M 2026-02-17T08:26:49.474 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-17T08:26:59.239 INFO:teuthology.orchestra.run.trial072.stdout:(1/35): ceph-base-19.2.3-705.g04cf6dd4.el9.x86_ 592 kB/s | 5.5 MB 00:09 2026-02-17T08:26:59.293 INFO:teuthology.orchestra.run.trial072.stdout:(2/35): ceph-selinux-19.2.3-705.g04cf6dd4.el9.x 465 kB/s | 25 kB 00:00 2026-02-17T08:26:59.667 INFO:teuthology.orchestra.run.trial072.stdout:(3/35): libcephfs2-19.2.3-705.g04cf6dd4.el9.x86 2.6 MB/s | 1.0 MB 00:00 2026-02-17T08:26:59.700 INFO:teuthology.orchestra.run.trial072.stdout:(4/35): ceph-radosgw-19.2.3-705.g04cf6dd4.el9.x 1.1 MB/s | 11 MB 00:09 2026-02-17T08:26:59.932 INFO:teuthology.orchestra.run.trial072.stdout:(5/35): libradosstriper1-19.2.3-705.g04cf6dd4.e 1.9 MB/s | 503 kB 00:00 2026-02-17T08:26:59.985 INFO:teuthology.orchestra.run.trial072.stdout:(6/35): python3-ceph-argparse-19.2.3-705.g04cf6 852 kB/s | 45 kB 00:00 2026-02-17T08:27:00.163 INFO:teuthology.orchestra.run.trial072.stdout:(7/35): python3-ceph-common-19.2.3-705.g04cf6dd 864 kB/s | 154 kB 00:00 2026-02-17T08:27:00.341 INFO:teuthology.orchestra.run.trial072.stdout:(8/35): python3-cephfs-19.2.3-705.g04cf6dd4.el9 928 kB/s | 165 kB 00:00 2026-02-17T08:27:00.623 INFO:teuthology.orchestra.run.trial072.stdout:(9/35): python3-rados-19.2.3-705.g04cf6dd4.el9. 1.1 MB/s | 323 kB 00:00 2026-02-17T08:27:00.859 INFO:teuthology.orchestra.run.trial072.stdout:(10/35): python3-rbd-19.2.3-705.g04cf6dd4.el9.x 1.3 MB/s | 303 kB 00:00 2026-02-17T08:27:00.957 INFO:teuthology.orchestra.run.trial072.stdout:(11/35): python3-rgw-19.2.3-705.g04cf6dd4.el9.x 1.0 MB/s | 100 kB 00:00 2026-02-17T08:27:00.979 INFO:teuthology.orchestra.run.trial072.stdout:(12/35): librgw2-19.2.3-705.g04cf6dd4.el9.x86_6 4.2 MB/s | 5.4 MB 00:01 2026-02-17T08:27:01.035 INFO:teuthology.orchestra.run.trial072.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 424 kB/s | 33 kB 00:00 2026-02-17T08:27:01.072 INFO:teuthology.orchestra.run.trial072.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 2.4 MB/s | 93 kB 00:00 2026-02-17T08:27:01.134 INFO:teuthology.orchestra.run.trial072.stdout:(15/35): nvme-cli-2.13-1.el9.x86_64.rpm 7.1 MB/s | 1.1 MB 00:00 2026-02-17T08:27:01.813 INFO:teuthology.orchestra.run.trial072.stdout:(16/35): boost-program-options-1.75.0-13.el9.x8 140 kB/s | 104 kB 00:00 2026-02-17T08:27:02.061 INFO:teuthology.orchestra.run.trial072.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 647 kB/s | 160 kB 00:00 2026-02-17T08:27:02.146 INFO:teuthology.orchestra.run.trial072.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 162 kB/s | 164 kB 00:01 2026-02-17T08:27:02.146 INFO:teuthology.orchestra.run.trial072.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 530 kB/s | 45 kB 00:00 2026-02-17T08:27:02.960 INFO:teuthology.orchestra.run.trial072.stdout:(20/35): librdkafka-1.6.1-102.el9.x86_64.rpm 813 kB/s | 662 kB 00:00 2026-02-17T08:27:03.051 INFO:teuthology.orchestra.run.trial072.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 323 kB/s | 292 kB 00:00 2026-02-17T08:27:03.218 INFO:teuthology.orchestra.run.trial072.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 221 kB/s | 37 kB 00:00 2026-02-17T08:27:03.289 INFO:teuthology.orchestra.run.trial072.stdout:(23/35): qatlib-25.08.0-2.el9.x86_64.rpm 729 kB/s | 240 kB 00:00 2026-02-17T08:27:03.386 INFO:teuthology.orchestra.run.trial072.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 396 kB/s | 66 kB 00:00 2026-02-17T08:27:03.445 INFO:teuthology.orchestra.run.trial072.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.9 MB/s | 308 kB 00:00 2026-02-17T08:27:03.471 INFO:teuthology.orchestra.run.trial072.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 960 kB/s | 25 kB 00:00 2026-02-17T08:27:03.499 INFO:teuthology.orchestra.run.trial072.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 1.7 MB/s | 49 kB 00:00 2026-02-17T08:27:03.526 INFO:teuthology.orchestra.run.trial072.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2026-02-17T08:27:03.571 INFO:teuthology.orchestra.run.trial072.stdout:(29/35): ceph-common-19.2.3-705.g04cf6dd4.el9.x 1.6 MB/s | 22 MB 00:13 2026-02-17T08:27:03.594 INFO:teuthology.orchestra.run.trial072.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-17T08:27:03.616 INFO:teuthology.orchestra.run.trial072.stdout:(31/35): libarrow-9.0.0-15.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2026-02-17T08:27:03.656 INFO:teuthology.orchestra.run.trial072.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 26 MB/s | 1.6 MB 00:00 2026-02-17T08:27:03.670 INFO:teuthology.orchestra.run.trial072.stdout:(33/35): re2-20211101-20.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2026-02-17T08:27:04.403 INFO:teuthology.orchestra.run.trial072.stdout:(34/35): librbd1-19.2.3-705.g04cf6dd4.el9.x86_6 4.2 MB/s | 3.2 MB 00:00 2026-02-17T08:27:05.221 INFO:teuthology.orchestra.run.trial072.stdout:(35/35): librados2-19.2.3-705.g04cf6dd4.el9.x86 2.1 MB/s | 3.4 MB 00:01 2026-02-17T08:27:05.225 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:27:05.225 INFO:teuthology.orchestra.run.trial072.stdout:Total 4.0 MB/s | 63 MB 00:15 2026-02-17T08:27:05.320 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-17T08:27:05.339 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-17T08:27:05.339 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-17T08:27:05.576 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-17T08:27:05.577 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-17T08:27:05.870 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-17T08:27:05.878 INFO:teuthology.orchestra.run.trial072.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T08:27:05.881 INFO:teuthology.orchestra.run.trial072.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T08:27:05.892 INFO:teuthology.orchestra.run.trial072.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T08:27:06.047 INFO:teuthology.orchestra.run.trial072.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T08:27:06.051 INFO:teuthology.orchestra.run.trial072.stdout: Upgrading : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T08:27:06.080 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T08:27:06.123 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T08:27:06.123 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T08:27:06.134 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T08:27:06.138 INFO:teuthology.orchestra.run.trial072.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T08:27:06.147 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 9/37 2026-02-17T08:27:06.170 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T08:27:06.171 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T08:27:06.184 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T08:27:06.216 INFO:teuthology.orchestra.run.trial072.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T08:27:06.220 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T08:27:06.226 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T08:27:06.229 INFO:teuthology.orchestra.run.trial072.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T08:27:06.232 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T08:27:06.236 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T08:27:06.381 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T08:27:06.382 INFO:teuthology.orchestra.run.trial072.stdout: Upgrading : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T08:27:06.408 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T08:27:06.410 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 20/37 2026-02-17T08:27:06.418 INFO:teuthology.orchestra.run.trial072.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T08:27:06.649 INFO:teuthology.orchestra.run.trial072.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T08:27:06.650 INFO:teuthology.orchestra.run.trial072.stdout: Installing : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T08:27:06.667 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T08:27:06.670 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 24/37 2026-02-17T08:27:06.675 INFO:teuthology.orchestra.run.trial072.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T08:27:06.678 INFO:teuthology.orchestra.run.trial072.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T08:27:06.678 INFO:teuthology.orchestra.run.trial072.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T08:27:06.697 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T08:27:06.811 INFO:teuthology.orchestra.run.trial072.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T08:27:06.813 INFO:teuthology.orchestra.run.trial072.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T08:27:07.087 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T08:27:07.087 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T08:27:07.087 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:07.127 INFO:teuthology.orchestra.run.trial072.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T08:27:07.129 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 31/37 2026-02-17T08:27:08.133 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T08:27:08.135 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T08:27:08.422 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T08:27:08.425 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T08:27:08.462 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T08:27:08.462 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T08:27:08.462 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T08:27:08.462 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:08.465 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T08:27:12.975 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T08:27:12.975 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /sys 2026-02-17T08:27:12.975 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /proc 2026-02-17T08:27:12.976 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /mnt 2026-02-17T08:27:12.976 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /var/tmp 2026-02-17T08:27:12.976 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /home 2026-02-17T08:27:12.976 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /root 2026-02-17T08:27:12.976 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /tmp 2026-02-17T08:27:12.976 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:13.440 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T08:27:13.463 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T08:27:13.463 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:27:13.463 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T08:27:13.463 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:27:13.463 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:27:13.464 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:13.464 INFO:teuthology.orchestra.run.trial072.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T08:27:13.477 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T08:27:13.477 INFO:teuthology.orchestra.run.trial072.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T08:27:13.530 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T08:27:13.531 INFO:teuthology.orchestra.run.trial072.stdout:Creating group 'qat' with GID 992. 2026-02-17T08:27:13.531 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:13.803 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/37 2026-02-17T08:27:13.804 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/37 2026-02-17T08:27:13.804 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/37 2026-02-17T08:27:13.804 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/37 2026-02-17T08:27:13.804 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T08:27:13.804 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T08:27:13.804 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T08:27:13.804 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 8/37 2026-02-17T08:27:13.804 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 9/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 12/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 13/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T08:27:13.805 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T08:27:13.806 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T08:27:13.807 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T08:27:13.807 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 36/37 2026-02-17T08:27:13.865 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T08:27:13.865 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:13.865 INFO:teuthology.orchestra.run.trial072.stdout:Upgraded: 2026-02-17T08:27:13.865 INFO:teuthology.orchestra.run.trial072.stdout: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.865 INFO:teuthology.orchestra.run.trial072.stdout: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.865 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-17T08:27:13.865 INFO:teuthology.orchestra.run.trial072.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T08:27:13.865 INFO:teuthology.orchestra.run.trial072.stdout: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T08:27:13.866 INFO:teuthology.orchestra.run.trial072.stdout: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.867 INFO:teuthology.orchestra.run.trial072.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T08:27:13.867 INFO:teuthology.orchestra.run.trial072.stdout: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.867 INFO:teuthology.orchestra.run.trial072.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T08:27:13.867 INFO:teuthology.orchestra.run.trial072.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T08:27:13.867 INFO:teuthology.orchestra.run.trial072.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T08:27:13.867 INFO:teuthology.orchestra.run.trial072.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T08:27:13.867 INFO:teuthology.orchestra.run.trial072.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T08:27:13.867 INFO:teuthology.orchestra.run.trial072.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T08:27:13.867 INFO:teuthology.orchestra.run.trial072.stdout: python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.867 INFO:teuthology.orchestra.run.trial072.stdout: python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.867 INFO:teuthology.orchestra.run.trial072.stdout: python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.868 INFO:teuthology.orchestra.run.trial072.stdout: python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.868 INFO:teuthology.orchestra.run.trial072.stdout: python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.868 INFO:teuthology.orchestra.run.trial072.stdout: python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:13.868 INFO:teuthology.orchestra.run.trial072.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T08:27:13.868 INFO:teuthology.orchestra.run.trial072.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T08:27:13.868 INFO:teuthology.orchestra.run.trial072.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T08:27:13.868 INFO:teuthology.orchestra.run.trial072.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T08:27:13.868 INFO:teuthology.orchestra.run.trial072.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T08:27:13.868 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:13.868 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:13.907 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-test 2026-02-17T08:27:14.224 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:26 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:14.308 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:14.309 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:14.309 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repository Size 2026-02-17T08:27:14.309 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:14.309 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-17T08:27:14.309 INFO:teuthology.orchestra.run.trial072.stdout: ceph-test x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 50 M 2026-02-17T08:27:14.309 INFO:teuthology.orchestra.run.trial072.stdout:Installing dependencies: 2026-02-17T08:27:14.309 INFO:teuthology.orchestra.run.trial072.stdout: libcephsqlite x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 163 k 2026-02-17T08:27:14.309 INFO:teuthology.orchestra.run.trial072.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T08:27:14.310 INFO:teuthology.orchestra.run.trial072.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T08:27:14.310 INFO:teuthology.orchestra.run.trial072.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T08:27:14.310 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:14.310 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-17T08:27:14.310 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:14.310 INFO:teuthology.orchestra.run.trial072.stdout:Install 5 Packages 2026-02-17T08:27:14.310 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:14.311 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 50 M 2026-02-17T08:27:14.311 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 212 M 2026-02-17T08:27:14.311 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-17T08:27:14.475 INFO:teuthology.orchestra.run.trial072.stdout:(1/5): libcephsqlite-19.2.3-705.g04cf6dd4.el9.x 1.6 MB/s | 163 kB 00:00 2026-02-17T08:27:14.899 INFO:teuthology.orchestra.run.trial072.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 443 kB/s | 233 kB 00:00 2026-02-17T08:27:14.991 INFO:teuthology.orchestra.run.trial072.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 692 kB/s | 64 kB 00:00 2026-02-17T08:27:15.091 INFO:teuthology.orchestra.run.trial072.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 492 kB/s | 303 kB 00:00 2026-02-17T08:27:15.383 INFO:teuthology.orchestra.run.trial072.stdout:(5/5): ceph-test-19.2.3-705.g04cf6dd4.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T08:27:15.385 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:27:15.385 INFO:teuthology.orchestra.run.trial072.stdout:Total 47 MB/s | 50 MB 00:01 2026-02-17T08:27:15.413 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-17T08:27:15.422 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-17T08:27:15.423 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-17T08:27:15.607 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-17T08:27:15.607 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-17T08:27:15.819 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-17T08:27:15.825 INFO:teuthology.orchestra.run.trial072.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T08:27:15.829 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T08:27:15.836 INFO:teuthology.orchestra.run.trial072.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T08:27:15.837 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T08:27:18.174 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T08:27:18.192 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T08:27:18.439 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T08:27:18.439 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/5 2026-02-17T08:27:18.439 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/5 2026-02-17T08:27:18.440 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T08:27:18.440 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T08:27:18.492 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T08:27:18.492 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:18.492 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-17T08:27:18.492 INFO:teuthology.orchestra.run.trial072.stdout: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:18.492 INFO:teuthology.orchestra.run.trial072.stdout: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:18.492 INFO:teuthology.orchestra.run.trial072.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T08:27:18.492 INFO:teuthology.orchestra.run.trial072.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T08:27:18.492 INFO:teuthology.orchestra.run.trial072.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T08:27:18.493 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:18.493 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:18.526 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph 2026-02-17T08:27:18.828 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:18.914 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout:====================================================================================== 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repository Size 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout:====================================================================================== 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: ceph x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.5 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout:Installing dependencies: 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: ceph-grafana-dashboards noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 31 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mds x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 2.4 M 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-modules-core noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 253 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mon x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 4.7 M 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: ceph-osd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 17 M 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: ceph-prometheus-alerts noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 17 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 769 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T08:27:18.917 INFO:teuthology.orchestra.run.trial072.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T08:27:18.918 INFO:teuthology.orchestra.run.trial072.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout:Installing weak dependencies: 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 150 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-dashboard noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 3.8 M 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 7.4 M 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 22 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-rook noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 49 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: ceph-volume noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 299 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout:====================================================================================== 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout:Install 99 Packages 2026-02-17T08:27:18.919 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:18.920 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 95 M 2026-02-17T08:27:18.920 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 520 M 2026-02-17T08:27:18.920 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-17T08:27:19.240 INFO:teuthology.orchestra.run.trial072.stdout:(1/99): ceph-19.2.3-705.g04cf6dd4.el9.x86_64.rp 128 kB/s | 6.5 kB 00:00 2026-02-17T08:27:19.332 INFO:teuthology.orchestra.run.trial072.stdout:(2/99): ceph-mgr-19.2.3-705.g04cf6dd4.el9.x86_6 7.5 MB/s | 1.1 MB 00:00 2026-02-17T08:27:19.359 INFO:teuthology.orchestra.run.trial072.stdout:(3/99): ceph-mds-19.2.3-705.g04cf6dd4.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-17T08:27:19.393 INFO:teuthology.orchestra.run.trial072.stdout:(4/99): ceph-grafana-dashboards-19.2.3-705.g04c 907 kB/s | 31 kB 00:00 2026-02-17T08:27:19.432 INFO:teuthology.orchestra.run.trial072.stdout:(5/99): ceph-mgr-cephadm-19.2.3-705.g04cf6dd4.e 3.8 MB/s | 150 kB 00:00 2026-02-17T08:27:19.462 INFO:teuthology.orchestra.run.trial072.stdout:(6/99): ceph-mon-19.2.3-705.g04cf6dd4.el9.x86_6 21 MB/s | 4.7 MB 00:00 2026-02-17T08:27:19.609 INFO:teuthology.orchestra.run.trial072.stdout:(7/99): ceph-mgr-dashboard-19.2.3-705.g04cf6dd4 21 MB/s | 3.8 MB 00:00 2026-02-17T08:27:19.653 INFO:teuthology.orchestra.run.trial072.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-705.g04cf6dd4 501 kB/s | 22 kB 00:00 2026-02-17T08:27:19.704 INFO:teuthology.orchestra.run.trial072.stdout:(9/99): ceph-mgr-modules-core-19.2.3-705.g04cf6 4.9 MB/s | 253 kB 00:00 2026-02-17T08:27:19.753 INFO:teuthology.orchestra.run.trial072.stdout:(10/99): ceph-mgr-rook-19.2.3-705.g04cf6dd4.el9 1.0 MB/s | 49 kB 00:00 2026-02-17T08:27:19.783 INFO:teuthology.orchestra.run.trial072.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-7 23 MB/s | 7.4 MB 00:00 2026-02-17T08:27:19.787 INFO:teuthology.orchestra.run.trial072.stdout:(12/99): ceph-prometheus-alerts-19.2.3-705.g04c 498 kB/s | 17 kB 00:00 2026-02-17T08:27:19.814 INFO:teuthology.orchestra.run.trial072.stdout:(13/99): ceph-volume-19.2.3-705.g04cf6dd4.el9.n 9.5 MB/s | 299 kB 00:00 2026-02-17T08:27:19.832 INFO:teuthology.orchestra.run.trial072.stdout:(14/99): cephadm-19.2.3-705.g04cf6dd4.el9.noarc 17 MB/s | 769 kB 00:00 2026-02-17T08:27:19.895 INFO:teuthology.orchestra.run.trial072.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 646 kB/s | 40 kB 00:00 2026-02-17T08:27:19.917 INFO:teuthology.orchestra.run.trial072.stdout:(16/99): libconfig-1.7.2-9.el9.x86_64.rpm 3.2 MB/s | 72 kB 00:00 2026-02-17T08:27:19.919 INFO:teuthology.orchestra.run.trial072.stdout:(17/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 3.3 MB/s | 350 kB 00:00 2026-02-17T08:27:19.945 INFO:teuthology.orchestra.run.trial072.stdout:(18/99): ceph-osd-19.2.3-705.g04cf6dd4.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T08:27:19.946 INFO:teuthology.orchestra.run.trial072.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 6.7 MB/s | 184 kB 00:00 2026-02-17T08:27:19.983 INFO:teuthology.orchestra.run.trial072.stdout:(20/99): libgfortran-11.5.0-14.el9.x86_64.rpm 12 MB/s | 794 kB 00:00 2026-02-17T08:27:20.006 INFO:teuthology.orchestra.run.trial072.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 4.5 MB/s | 106 kB 00:00 2026-02-17T08:27:20.011 INFO:teuthology.orchestra.run.trial072.stdout:(22/99): python3-cryptography-36.0.1-5.el9.x86_ 19 MB/s | 1.2 MB 00:00 2026-02-17T08:27:20.029 INFO:teuthology.orchestra.run.trial072.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 5.9 MB/s | 135 kB 00:00 2026-02-17T08:27:20.035 INFO:teuthology.orchestra.run.trial072.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 6.2 MB/s | 150 kB 00:00 2026-02-17T08:27:20.053 INFO:teuthology.orchestra.run.trial072.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 5.3 MB/s | 126 kB 00:00 2026-02-17T08:27:20.053 INFO:teuthology.orchestra.run.trial072.stdout:(26/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2026-02-17T08:27:20.061 INFO:teuthology.orchestra.run.trial072.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 8.3 MB/s | 218 kB 00:00 2026-02-17T08:27:20.075 INFO:teuthology.orchestra.run.trial072.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 8.1 MB/s | 182 kB 00:00 2026-02-17T08:27:20.100 INFO:teuthology.orchestra.run.trial072.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 5.6 MB/s | 266 kB 00:00 2026-02-17T08:27:20.146 INFO:teuthology.orchestra.run.trial072.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 348 kB/s | 30 kB 00:00 2026-02-17T08:27:20.173 INFO:teuthology.orchestra.run.trial072.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 202 kB/s | 15 kB 00:00 2026-02-17T08:27:20.246 INFO:teuthology.orchestra.run.trial072.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.4 MB/s | 246 kB 00:00 2026-02-17T08:27:20.272 INFO:teuthology.orchestra.run.trial072.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-17T08:27:20.275 INFO:teuthology.orchestra.run.trial072.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2026-02-17T08:27:20.320 INFO:teuthology.orchestra.run.trial072.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 12 MB/s | 3.0 MB 00:00 2026-02-17T08:27:20.368 INFO:teuthology.orchestra.run.trial072.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2026-02-17T08:27:20.393 INFO:teuthology.orchestra.run.trial072.stdout:(37/99): python3-babel-2.9.1-2.el9.noarch.rpm 81 MB/s | 6.0 MB 00:00 2026-02-17T08:27:20.396 INFO:teuthology.orchestra.run.trial072.stdout:(38/99): python3-devel-3.9.25-2.el9.x86_64.rpm 8.5 MB/s | 244 kB 00:00 2026-02-17T08:27:20.421 INFO:teuthology.orchestra.run.trial072.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.7 MB/s | 249 kB 00:00 2026-02-17T08:27:20.425 INFO:teuthology.orchestra.run.trial072.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 6.1 MB/s | 177 kB 00:00 2026-02-17T08:27:20.444 INFO:teuthology.orchestra.run.trial072.stdout:(41/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 31 MB/s | 5.3 MB 00:00 2026-02-17T08:27:20.453 INFO:teuthology.orchestra.run.trial072.stdout:(42/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 40 MB/s | 1.2 MB 00:00 2026-02-17T08:27:20.454 INFO:teuthology.orchestra.run.trial072.stdout:(43/99): python3-mako-1.1.4-6.el9.noarch.rpm 5.7 MB/s | 172 kB 00:00 2026-02-17T08:27:20.470 INFO:teuthology.orchestra.run.trial072.stdout:(44/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-17T08:27:20.489 INFO:teuthology.orchestra.run.trial072.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 12 MB/s | 442 kB 00:00 2026-02-17T08:27:20.496 INFO:teuthology.orchestra.run.trial072.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 2.9 MB/s | 77 kB 00:00 2026-02-17T08:27:20.520 INFO:teuthology.orchestra.run.trial072.stdout:(47/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 91 MB/s | 6.1 MB 00:00 2026-02-17T08:27:20.521 INFO:teuthology.orchestra.run.trial072.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 8.1 MB/s | 267 kB 00:00 2026-02-17T08:27:20.523 INFO:teuthology.orchestra.run.trial072.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.7 MB/s | 159 kB 00:00 2026-02-17T08:27:20.549 INFO:teuthology.orchestra.run.trial072.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 9.7 MB/s | 279 kB 00:00 2026-02-17T08:27:20.550 INFO:teuthology.orchestra.run.trial072.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 1.8 MB/s | 54 kB 00:00 2026-02-17T08:27:20.575 INFO:teuthology.orchestra.run.trial072.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2026-02-17T08:27:20.578 INFO:teuthology.orchestra.run.trial072.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 6.6 MB/s | 189 kB 00:00 2026-02-17T08:27:20.601 INFO:teuthology.orchestra.run.trial072.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.4 MB/s | 90 kB 00:00 2026-02-17T08:27:20.950 INFO:teuthology.orchestra.run.trial072.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 45 MB/s | 19 MB 00:00 2026-02-17T08:27:21.034 INFO:teuthology.orchestra.run.trial072.stdout:(56/99): lua-devel-5.4.4-4.el9.x86_64.rpm 49 kB/s | 22 kB 00:00 2026-02-17T08:27:21.142 INFO:teuthology.orchestra.run.trial072.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 180 kB/s | 19 kB 00:00 2026-02-17T08:27:21.223 INFO:teuthology.orchestra.run.trial072.stdout:(58/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.0 MB/s | 551 kB 00:00 2026-02-17T08:27:21.301 INFO:teuthology.orchestra.run.trial072.stdout:(59/99): luarocks-3.9.2-5.el9.noarch.rpm 955 kB/s | 151 kB 00:00 2026-02-17T08:27:21.306 INFO:teuthology.orchestra.run.trial072.stdout:(60/99): python3-asyncssh-2.13.2-5.el9.noarch.r 6.4 MB/s | 548 kB 00:00 2026-02-17T08:27:21.474 INFO:teuthology.orchestra.run.trial072.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 359 kB/s | 60 kB 00:00 2026-02-17T08:27:21.475 INFO:teuthology.orchestra.run.trial072.stdout:(62/99): python3-autocommand-2.2.2-8.el9.noarch 169 kB/s | 29 kB 00:00 2026-02-17T08:27:21.526 INFO:teuthology.orchestra.run.trial072.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 832 kB/s | 43 kB 00:00 2026-02-17T08:27:21.527 INFO:teuthology.orchestra.run.trial072.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 620 kB/s | 32 kB 00:00 2026-02-17T08:27:21.568 INFO:teuthology.orchestra.run.trial072.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 337 kB/s | 14 kB 00:00 2026-02-17T08:27:21.589 INFO:teuthology.orchestra.run.trial072.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.7 MB/s | 173 kB 00:00 2026-02-17T08:27:21.738 INFO:teuthology.orchestra.run.trial072.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 2.1 MB/s | 358 kB 00:00 2026-02-17T08:27:21.753 INFO:teuthology.orchestra.run.trial072.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 1.5 MB/s | 254 kB 00:00 2026-02-17T08:27:21.830 INFO:teuthology.orchestra.run.trial072.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 1.9 MB/s | 144 kB 00:00 2026-02-17T08:27:21.878 INFO:teuthology.orchestra.run.trial072.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 2.8 MB/s | 139 kB 00:00 2026-02-17T08:27:21.902 INFO:teuthology.orchestra.run.trial072.stdout:(71/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2026-02-17T08:27:21.918 INFO:teuthology.orchestra.run.trial072.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 1.4 MB/s | 56 kB 00:00 2026-02-17T08:27:21.940 INFO:teuthology.orchestra.run.trial072.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 275 kB/s | 11 kB 00:00 2026-02-17T08:27:21.955 INFO:teuthology.orchestra.run.trial072.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 477 kB/s | 18 kB 00:00 2026-02-17T08:27:22.093 INFO:teuthology.orchestra.run.trial072.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 152 kB/s | 23 kB 00:00 2026-02-17T08:27:22.094 INFO:teuthology.orchestra.run.trial072.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 142 kB/s | 20 kB 00:00 2026-02-17T08:27:22.167 INFO:teuthology.orchestra.run.trial072.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 264 kB/s | 19 kB 00:00 2026-02-17T08:27:22.167 INFO:teuthology.orchestra.run.trial072.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 360 kB/s | 26 kB 00:00 2026-02-17T08:27:22.207 INFO:teuthology.orchestra.run.trial072.stdout:(79/99): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2026-02-17T08:27:22.216 INFO:teuthology.orchestra.run.trial072.stdout:(80/99): python3-kubernetes-26.1.0-3.el9.noarch 21 MB/s | 1.0 MB 00:00 2026-02-17T08:27:22.250 INFO:teuthology.orchestra.run.trial072.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2026-02-17T08:27:22.254 INFO:teuthology.orchestra.run.trial072.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2026-02-17T08:27:22.290 INFO:teuthology.orchestra.run.trial072.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2026-02-17T08:27:22.293 INFO:teuthology.orchestra.run.trial072.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 6.8 MB/s | 272 kB 00:00 2026-02-17T08:27:22.506 INFO:teuthology.orchestra.run.trial072.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 76 kB/s | 16 kB 00:00 2026-02-17T08:27:22.507 INFO:teuthology.orchestra.run.trial072.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 420 kB/s | 90 kB 00:00 2026-02-17T08:27:22.557 INFO:teuthology.orchestra.run.trial072.stdout:(87/99): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2026-02-17T08:27:22.558 INFO:teuthology.orchestra.run.trial072.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 595 kB/s | 31 kB 00:00 2026-02-17T08:27:22.595 INFO:teuthology.orchestra.run.trial072.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 1.5 MB/s | 59 kB 00:00 2026-02-17T08:27:22.605 INFO:teuthology.orchestra.run.trial072.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 2.6 MB/s | 125 kB 00:00 2026-02-17T08:27:22.632 INFO:teuthology.orchestra.run.trial072.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 961 kB/s | 36 kB 00:00 2026-02-17T08:27:22.649 INFO:teuthology.orchestra.run.trial072.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 2.0 MB/s | 86 kB 00:00 2026-02-17T08:27:22.671 INFO:teuthology.orchestra.run.trial072.stdout:(93/99): python3-webob-1.8.8-2.el9.noarch.rpm 5.9 MB/s | 230 kB 00:00 2026-02-17T08:27:22.692 INFO:teuthology.orchestra.run.trial072.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 2.0 MB/s | 90 kB 00:00 2026-02-17T08:27:22.712 INFO:teuthology.orchestra.run.trial072.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 10 MB/s | 427 kB 00:00 2026-02-17T08:27:22.732 INFO:teuthology.orchestra.run.trial072.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.2 MB/s | 48 kB 00:00 2026-02-17T08:27:22.749 INFO:teuthology.orchestra.run.trial072.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 598 kB/s | 22 kB 00:00 2026-02-17T08:27:22.770 INFO:teuthology.orchestra.run.trial072.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 527 kB/s | 20 kB 00:00 2026-02-17T08:27:23.073 INFO:teuthology.orchestra.run.trial072.stdout:(99/99): protobuf-compiler-3.14.0-17.el9.x86_64 349 kB/s | 862 kB 00:02 2026-02-17T08:27:23.076 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:27:23.076 INFO:teuthology.orchestra.run.trial072.stdout:Total 23 MB/s | 95 MB 00:04 2026-02-17T08:27:23.495 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-17T08:27:23.533 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-17T08:27:23.533 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-17T08:27:23.950 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-17T08:27:23.951 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-17T08:27:24.394 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-17T08:27:24.395 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T08:27:24.426 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T08:27:24.431 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T08:27:24.453 INFO:teuthology.orchestra.run.trial072.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T08:27:24.459 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T08:27:24.492 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T08:27:24.502 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T08:27:24.507 INFO:teuthology.orchestra.run.trial072.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T08:27:24.509 INFO:teuthology.orchestra.run.trial072.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T08:27:24.514 INFO:teuthology.orchestra.run.trial072.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T08:27:24.537 INFO:teuthology.orchestra.run.trial072.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T08:27:24.549 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T08:27:24.552 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T08:27:24.558 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T08:27:24.560 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T08:27:24.571 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T08:27:24.577 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T08:27:24.601 INFO:teuthology.orchestra.run.trial072.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T08:27:24.604 INFO:teuthology.orchestra.run.trial072.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T08:27:24.611 INFO:teuthology.orchestra.run.trial072.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T08:27:24.636 INFO:teuthology.orchestra.run.trial072.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T08:27:24.687 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T08:27:24.700 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T08:27:24.703 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T08:27:24.707 INFO:teuthology.orchestra.run.trial072.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T08:27:24.713 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T08:27:24.717 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T08:27:24.720 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T08:27:24.735 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T08:27:24.756 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T08:27:24.760 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T08:27:24.765 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T08:27:24.777 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T08:27:24.786 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T08:27:24.792 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T08:27:24.811 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T08:27:24.820 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T08:27:24.874 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T08:27:24.886 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T08:27:24.902 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T08:27:24.907 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T08:27:24.915 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T08:27:24.954 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T08:27:25.281 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T08:27:25.291 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T08:27:25.295 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T08:27:25.301 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T08:27:25.302 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T08:27:25.331 INFO:teuthology.orchestra.run.trial072.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T08:27:25.374 INFO:teuthology.orchestra.run.trial072.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T08:27:25.381 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T08:27:25.385 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T08:27:25.391 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T08:27:25.394 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T08:27:25.401 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T08:27:25.405 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T08:27:25.433 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T08:27:25.442 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T08:27:25.477 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T08:27:25.703 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T08:27:25.726 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T08:27:25.730 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T08:27:25.789 INFO:teuthology.orchestra.run.trial072.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T08:27:25.791 INFO:teuthology.orchestra.run.trial072.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T08:27:25.812 INFO:teuthology.orchestra.run.trial072.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T08:27:26.137 INFO:teuthology.orchestra.run.trial072.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T08:27:26.210 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T08:27:26.882 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T08:27:26.899 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T08:27:26.909 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T08:27:26.916 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T08:27:26.929 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T08:27:26.945 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T08:27:27.020 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T08:27:27.029 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T08:27:27.052 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T08:27:27.082 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T08:27:27.132 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T08:27:27.138 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T08:27:27.142 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T08:27:27.143 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T08:27:27.160 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T08:27:27.161 INFO:teuthology.orchestra.run.trial072.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T08:27:27.161 INFO:teuthology.orchestra.run.trial072.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T08:27:27.161 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:27.168 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T08:27:27.193 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T08:27:27.193 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T08:27:27.194 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:27.227 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T08:27:27.292 INFO:teuthology.orchestra.run.trial072.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T08:27:27.294 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T08:27:27.307 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T08:27:27.307 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:27:27.307 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T08:27:27.307 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:28.019 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T08:27:28.044 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T08:27:28.044 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:27:28.044 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T08:27:28.044 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T08:27:28.044 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T08:27:28.045 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:28.101 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T08:27:28.104 INFO:teuthology.orchestra.run.trial072.stdout: Installing : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T08:27:28.109 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 88/99 2026-02-17T08:27:28.128 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 89/99 2026-02-17T08:27:28.130 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T08:27:28.624 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T08:27:28.628 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T08:27:29.087 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T08:27:29.088 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T08:27:29.100 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T08:27:29.101 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T08:27:29.157 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T08:27:29.207 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 94/99 2026-02-17T08:27:29.208 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T08:27:29.229 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T08:27:29.230 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:27:29.230 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T08:27:29.230 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T08:27:29.230 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T08:27:29.230 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:29.241 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T08:27:29.463 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T08:27:29.464 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T08:27:29.486 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T08:27:29.486 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:27:29.487 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T08:27:29.487 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T08:27:29.487 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T08:27:29.487 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:29.592 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T08:27:29.613 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T08:27:29.613 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:27:29.613 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T08:27:29.613 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T08:27:29.613 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T08:27:29.614 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:29.632 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T08:27:30.289 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T08:27:30.290 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/99 2026-02-17T08:27:30.290 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/99 2026-02-17T08:27:30.290 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/99 2026-02-17T08:27:30.290 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/99 2026-02-17T08:27:30.290 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/99 2026-02-17T08:27:30.290 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 6/99 2026-02-17T08:27:30.290 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 7/99 2026-02-17T08:27:30.290 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 8/99 2026-02-17T08:27:30.290 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 9/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 10/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 11/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 12/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 13/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 14/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 15/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T08:27:30.291 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T08:27:30.292 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T08:27:30.293 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T08:27:30.294 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T08:27:30.295 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T08:27:30.296 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T08:27:30.297 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T08:27:30.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T08:27:30.357 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:30.357 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-17T08:27:30.357 INFO:teuthology.orchestra.run.trial072.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T08:27:30.357 INFO:teuthology.orchestra.run.trial072.stdout: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:30.357 INFO:teuthology.orchestra.run.trial072.stdout: ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:27:30.357 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:30.357 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:30.357 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:27:30.357 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:27:30.357 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T08:27:30.358 INFO:teuthology.orchestra.run.trial072.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T08:27:30.359 INFO:teuthology.orchestra.run.trial072.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T08:27:30.360 INFO:teuthology.orchestra.run.trial072.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T08:27:30.361 INFO:teuthology.orchestra.run.trial072.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T08:27:30.362 INFO:teuthology.orchestra.run.trial072.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T08:27:30.363 INFO:teuthology.orchestra.run.trial072.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T08:27:30.364 INFO:teuthology.orchestra.run.trial072.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T08:27:30.365 INFO:teuthology.orchestra.run.trial072.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T08:27:30.365 INFO:teuthology.orchestra.run.trial072.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T08:27:30.365 INFO:teuthology.orchestra.run.trial072.stdout: zip-3.0-35.el9.x86_64 2026-02-17T08:27:30.365 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:30.365 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:30.411 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-base 2026-02-17T08:27:30.720 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:30.785 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:27:30.802 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:30.803 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:30.803 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:30.824 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install cephadm 2026-02-17T08:27:31.134 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:31.198 INFO:teuthology.orchestra.run.trial072.stdout:Package cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:27:31.216 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:31.216 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:31.216 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:31.237 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T08:27:31.542 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:31.624 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:31.625 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:31.625 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-17T08:27:31.625 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:31.625 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-17T08:27:31.625 INFO:teuthology.orchestra.run.trial072.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 145 k 2026-02-17T08:27:31.625 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:31.625 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-17T08:27:31.625 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:31.626 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-17T08:27:31.626 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:31.626 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 145 k 2026-02-17T08:27:31.626 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 431 k 2026-02-17T08:27:31.626 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-17T08:27:31.711 INFO:teuthology.orchestra.run.trial072.stdout:ceph-immutable-object-cache-19.2.3-705.g04cf6dd 1.7 MB/s | 145 kB 00:00 2026-02-17T08:27:31.712 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:27:31.712 INFO:teuthology.orchestra.run.trial072.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T08:27:31.712 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-17T08:27:31.715 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-17T08:27:31.716 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-17T08:27:31.747 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-17T08:27:31.747 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-17T08:27:31.801 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-17T08:27:31.802 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T08:27:31.824 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T08:27:31.824 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:27:31.824 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T08:27:31.825 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:32.106 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T08:27:32.106 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:32.106 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-17T08:27:32.106 INFO:teuthology.orchestra.run.trial072.stdout: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:32.107 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:32.107 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:32.133 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mgr 2026-02-17T08:27:32.443 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:32.507 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:27:32.524 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:32.525 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:32.525 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:32.547 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T08:27:32.861 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:32.925 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:27:32.943 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:32.943 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:32.943 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:32.964 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T08:27:33.274 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:33.338 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:27:33.355 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:33.356 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:33.356 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:33.377 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mgr-rook 2026-02-17T08:27:33.685 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:33.748 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:27:33.766 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:33.766 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:33.766 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:33.787 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T08:27:34.096 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:34.160 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:27:34.177 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:34.178 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:34.178 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:34.199 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-fuse 2026-02-17T08:27:34.508 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:34.588 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout: Package Architecture Version Repository Size 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout: ceph-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.2 M 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 1.2 M 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 3.6 M 2026-02-17T08:27:34.589 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-17T08:27:34.710 INFO:teuthology.orchestra.run.trial072.stdout:ceph-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 9.6 MB/s | 1.2 MB 00:00 2026-02-17T08:27:34.710 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:27:34.710 INFO:teuthology.orchestra.run.trial072.stdout:Total 9.6 MB/s | 1.2 MB 00:00 2026-02-17T08:27:34.710 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-17T08:27:34.713 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-17T08:27:34.714 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-17T08:27:34.747 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-17T08:27:34.747 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-17T08:27:34.849 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-17T08:27:34.866 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:35.081 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:35.139 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:35.139 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:35.139 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-17T08:27:35.139 INFO:teuthology.orchestra.run.trial072.stdout: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:35.139 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:35.139 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:35.168 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-volume 2026-02-17T08:27:35.485 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:35.550 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:27:35.568 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:35.568 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:35.568 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:35.590 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install librados-devel 2026-02-17T08:27:35.894 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:35.976 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:35.976 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:35.976 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-17T08:27:35.976 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:35.977 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-17T08:27:35.977 INFO:teuthology.orchestra.run.trial072.stdout: librados-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 126 k 2026-02-17T08:27:35.977 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:35.977 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-17T08:27:35.977 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:35.977 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-17T08:27:35.977 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:35.977 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 126 k 2026-02-17T08:27:35.977 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 456 k 2026-02-17T08:27:35.977 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-17T08:27:36.101 INFO:teuthology.orchestra.run.trial072.stdout:librados-devel-19.2.3-705.g04cf6dd4.el9.x86_64. 1.0 MB/s | 126 kB 00:00 2026-02-17T08:27:36.102 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:27:36.102 INFO:teuthology.orchestra.run.trial072.stdout:Total 1.0 MB/s | 126 kB 00:00 2026-02-17T08:27:36.102 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-17T08:27:36.105 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-17T08:27:36.105 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-17T08:27:36.136 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-17T08:27:36.136 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-17T08:27:36.190 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-17T08:27:36.207 INFO:teuthology.orchestra.run.trial072.stdout: Installing : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:36.286 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:36.343 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:36.343 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:36.344 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-17T08:27:36.344 INFO:teuthology.orchestra.run.trial072.stdout: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:36.344 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:36.344 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:36.372 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install libcephfs2 2026-02-17T08:27:36.679 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:36.744 INFO:teuthology.orchestra.run.trial072.stdout:Package libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:27:36.762 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:36.763 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:36.763 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:36.783 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install libcephfs-devel 2026-02-17T08:27:37.091 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:37.172 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:37.173 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:37.173 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-17T08:27:37.173 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:37.174 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-17T08:27:37.174 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 34 k 2026-02-17T08:27:37.174 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:37.174 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-17T08:27:37.174 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:37.174 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-17T08:27:37.174 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:37.174 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 34 k 2026-02-17T08:27:37.174 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 153 k 2026-02-17T08:27:37.174 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-17T08:27:37.244 INFO:teuthology.orchestra.run.trial072.stdout:libcephfs-devel-19.2.3-705.g04cf6dd4.el9.x86_64 475 kB/s | 34 kB 00:00 2026-02-17T08:27:37.245 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:27:37.245 INFO:teuthology.orchestra.run.trial072.stdout:Total 467 kB/s | 34 kB 00:00 2026-02-17T08:27:37.245 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-17T08:27:37.247 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-17T08:27:37.247 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-17T08:27:37.249 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-17T08:27:37.249 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-17T08:27:37.271 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-17T08:27:37.287 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:37.342 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:37.398 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:37.398 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:37.398 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-17T08:27:37.398 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:37.398 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:37.399 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:37.426 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install librados2 2026-02-17T08:27:37.728 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:37.791 INFO:teuthology.orchestra.run.trial072.stdout:Package librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:27:37.809 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:37.809 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:37.810 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:37.830 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install librbd1 2026-02-17T08:27:38.136 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:38.199 INFO:teuthology.orchestra.run.trial072.stdout:Package librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:27:38.217 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:38.217 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:38.217 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:38.238 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-rados 2026-02-17T08:27:38.546 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:38.611 INFO:teuthology.orchestra.run.trial072.stdout:Package python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:27:38.628 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:38.629 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:38.629 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:38.650 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-rgw 2026-02-17T08:27:38.959 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:39.022 INFO:teuthology.orchestra.run.trial072.stdout:Package python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:27:39.039 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:39.040 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:39.040 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:39.061 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-cephfs 2026-02-17T08:27:39.373 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:39.437 INFO:teuthology.orchestra.run.trial072.stdout:Package python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:27:39.454 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:39.455 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:39.455 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:39.476 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-rbd 2026-02-17T08:27:39.781 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:39.845 INFO:teuthology.orchestra.run.trial072.stdout:Package python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:27:39.863 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:39.863 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-17T08:27:39.864 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:39.884 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install rbd-fuse 2026-02-17T08:27:40.191 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:40.272 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:40.272 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:40.272 INFO:teuthology.orchestra.run.trial072.stdout: Package Architecture Version Repository Size 2026-02-17T08:27:40.272 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:40.272 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-17T08:27:40.272 INFO:teuthology.orchestra.run.trial072.stdout: rbd-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 85 k 2026-02-17T08:27:40.272 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:40.272 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-17T08:27:40.272 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:40.273 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-17T08:27:40.273 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:40.273 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 85 k 2026-02-17T08:27:40.273 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 227 k 2026-02-17T08:27:40.273 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-17T08:27:40.354 INFO:teuthology.orchestra.run.trial072.stdout:rbd-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 1.0 MB/s | 85 kB 00:00 2026-02-17T08:27:40.355 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:27:40.355 INFO:teuthology.orchestra.run.trial072.stdout:Total 1.0 MB/s | 85 kB 00:00 2026-02-17T08:27:40.355 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-17T08:27:40.360 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-17T08:27:40.360 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-17T08:27:40.390 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-17T08:27:40.391 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-17T08:27:40.441 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-17T08:27:40.458 INFO:teuthology.orchestra.run.trial072.stdout: Installing : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:40.536 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:40.593 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:40.593 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:40.593 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-17T08:27:40.593 INFO:teuthology.orchestra.run.trial072.stdout: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:40.593 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:40.594 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:40.622 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install rbd-mirror 2026-02-17T08:27:40.934 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:41.016 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:41.017 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:41.017 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-17T08:27:41.017 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:41.017 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-17T08:27:41.017 INFO:teuthology.orchestra.run.trial072.stdout: rbd-mirror x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.1 M 2026-02-17T08:27:41.017 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:41.017 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-17T08:27:41.018 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:41.018 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-17T08:27:41.018 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:41.018 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 3.1 M 2026-02-17T08:27:41.018 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 13 M 2026-02-17T08:27:41.018 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-17T08:27:41.171 INFO:teuthology.orchestra.run.trial072.stdout:rbd-mirror-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 20 MB/s | 3.1 MB 00:00 2026-02-17T08:27:41.172 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:27:41.172 INFO:teuthology.orchestra.run.trial072.stdout:Total 20 MB/s | 3.1 MB 00:00 2026-02-17T08:27:41.172 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-17T08:27:41.175 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-17T08:27:41.175 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-17T08:27:41.218 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-17T08:27:41.218 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-17T08:27:41.412 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-17T08:27:41.414 INFO:teuthology.orchestra.run.trial072.stdout: Installing : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:41.437 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:41.437 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:27:41.437 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T08:27:41.437 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T08:27:41.437 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T08:27:41.437 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:41.754 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:41.754 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:41.754 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-17T08:27:41.754 INFO:teuthology.orchestra.run.trial072.stdout: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:41.755 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:41.755 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:41.783 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install rbd-nbd 2026-02-17T08:27:42.098 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Feb 2026 08:26:48 AM UTC. 2026-02-17T08:27:42.180 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-17T08:27:42.181 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:42.181 INFO:teuthology.orchestra.run.trial072.stdout: Package Architecture Version Repository Size 2026-02-17T08:27:42.181 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:42.182 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-17T08:27:42.182 INFO:teuthology.orchestra.run.trial072.stdout: rbd-nbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 171 k 2026-02-17T08:27:42.182 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:42.182 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-17T08:27:42.182 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-17T08:27:42.182 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-17T08:27:42.182 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:42.182 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 171 k 2026-02-17T08:27:42.182 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 490 k 2026-02-17T08:27:42.182 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-17T08:27:42.289 INFO:teuthology.orchestra.run.trial072.stdout:rbd-nbd-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 1.6 MB/s | 171 kB 00:00 2026-02-17T08:27:42.289 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:27:42.290 INFO:teuthology.orchestra.run.trial072.stdout:Total 1.5 MB/s | 171 kB 00:00 2026-02-17T08:27:42.290 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-17T08:27:42.295 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-17T08:27:42.295 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-17T08:27:42.326 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-17T08:27:42.326 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-17T08:27:42.382 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-17T08:27:42.398 INFO:teuthology.orchestra.run.trial072.stdout: Installing : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:42.480 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:42.538 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:27:42.538 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:42.538 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-17T08:27:42.538 INFO:teuthology.orchestra.run.trial072.stdout: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:27:42.538 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-17T08:27:42.538 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-17T08:27:42.570 DEBUG:teuthology.parallel:result is None 2026-02-17T08:27:42.570 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:27:42.736 DEBUG:teuthology.orchestra.run.trial072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T08:27:42.758 INFO:teuthology.orchestra.run.trial072.stdout:19.2.3-705.g04cf6dd4.el9 2026-02-17T08:27:42.758 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705.g04cf6dd4.el9 2026-02-17T08:27:42.758 INFO:teuthology.task.install:The correct ceph version 19.2.3-705.g04cf6dd4 is installed. 2026-02-17T08:27:42.761 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T08:27:42.761 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-17T08:27:42.761 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T08:27:42.823 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T08:27:42.823 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-17T08:27:42.823 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T08:27:42.889 DEBUG:teuthology.orchestra.run.trial072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T08:27:42.953 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T08:27:42.953 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-17T08:27:42.953 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T08:27:43.018 DEBUG:teuthology.orchestra.run.trial072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T08:27:43.082 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T08:27:43.083 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-17T08:27:43.083 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T08:27:43.145 DEBUG:teuthology.orchestra.run.trial072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T08:27:43.208 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T08:27:43.235 INFO:tasks.workunit:Pulling workunits from ref 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:27:43.235 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T08:27:43.235 INFO:tasks.workunit:timeout=3h 2026-02-17T08:27:43.236 INFO:tasks.workunit:cleanup=True 2026-02-17T08:27:43.236 DEBUG:teuthology.orchestra.run.trial072:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T08:27:43.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:27:43.264 INFO:teuthology.orchestra.run.trial072.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T08:27:43.265 DEBUG:teuthology.orchestra.run.trial072:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T08:27:43.320 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T08:27:43.321 DEBUG:teuthology.orchestra.run.trial072:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T08:27:43.376 DEBUG:teuthology.orchestra.run.trial072:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:27:43.440 INFO:tasks.workunit.client.0.trial072.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T08:28:02.536 INFO:tasks.workunit.client.0.trial072.stderr:Note: switching to '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'. 2026-02-17T08:28:02.536 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-17T08:28:02.536 INFO:tasks.workunit.client.0.trial072.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T08:28:02.536 INFO:tasks.workunit.client.0.trial072.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T08:28:02.536 INFO:tasks.workunit.client.0.trial072.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T08:28:02.537 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-17T08:28:02.537 INFO:tasks.workunit.client.0.trial072.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T08:28:02.537 INFO:tasks.workunit.client.0.trial072.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T08:28:02.537 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-17T08:28:02.537 INFO:tasks.workunit.client.0.trial072.stderr: git switch -c 2026-02-17T08:28:02.537 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-17T08:28:02.537 INFO:tasks.workunit.client.0.trial072.stderr:Or undo this operation with: 2026-02-17T08:28:02.537 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-17T08:28:02.537 INFO:tasks.workunit.client.0.trial072.stderr: git switch - 2026-02-17T08:28:02.537 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-17T08:28:02.537 INFO:tasks.workunit.client.0.trial072.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T08:28:02.538 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-17T08:28:02.538 INFO:tasks.workunit.client.0.trial072.stderr:HEAD is now at 04cf6dd4be4 Merge branch 'wip-squid-update-spdk' of https://github.com/tchaikov/ceph into wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:28:02.543 DEBUG:teuthology.orchestra.run.trial072:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T08:28:02.600 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-17T08:28:02.600 DEBUG:teuthology.orchestra.run.trial072:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T08:28:02.657 INFO:tasks.workunit:Running workunits matching mgr on client.0... 2026-02-17T08:28:02.658 INFO:tasks.workunit:Running workunit mgr/balancer.sh... 2026-02-17T08:28:02.659 DEBUG:teuthology.orchestra.run.trial072:workunit test mgr/balancer.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh 2026-02-17T08:28:02.721 INFO:tasks.workunit.client.0.trial072.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T08:28:02.724 INFO:tasks.workunit.client.0.trial072.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T08:28:02.725 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T08:28:02.725 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T08:28:02.725 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T08:28:02.725 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T08:28:02.725 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T08:28:02.725 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T08:28:02.725 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T08:28:02.725 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T08:28:02.725 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/balancer 2026-02-17T08:28:02.725 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:20: run: local dir=td/balancer 2026-02-17T08:28:02.726 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:21: run: shift 2026-02-17T08:28:02.726 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:23: run: export CEPH_MON=127.0.0.1:7102 2026-02-17T08:28:02.726 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:23: run: CEPH_MON=127.0.0.1:7102 2026-02-17T08:28:02.726 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:24: run: export CEPH_ARGS 2026-02-17T08:28:02.726 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:25: run: uuidgen 2026-02-17T08:28:02.727 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:25: run: CEPH_ARGS+='--fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none ' 2026-02-17T08:28:02.727 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:26: run: CEPH_ARGS+='--mon-host=127.0.0.1:7102 ' 2026-02-17T08:28:02.727 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:28: run: set 2026-02-17T08:28:02.727 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:28: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T08:28:02.729 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:28: run: local 'funcs=TEST_balancer 2026-02-17T08:28:02.729 INFO:tasks.workunit.client.0.trial072.stderr:TEST_balancer2' 2026-02-17T08:28:02.729 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:29: run: for func in $funcs 2026-02-17T08:28:02.729 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:30: run: TEST_balancer td/balancer 2026-02-17T08:28:02.729 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:38: TEST_balancer: local dir=td/balancer 2026-02-17T08:28:02.729 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:40: TEST_balancer: setup td/balancer 2026-02-17T08:28:02.729 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/balancer 2026-02-17T08:28:02.729 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/balancer 2026-02-17T08:28:02.729 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/balancer 2026-02-17T08:28:02.729 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:28:02.730 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/balancer KILL 2026-02-17T08:28:02.730 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:28:02.730 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:28:02.730 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:28:02.730 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:28:02.730 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:28:02.731 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:28:02.731 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:28:02.731 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:28:02.731 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:28:02.732 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:28:02.732 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:28:02.732 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:28:02.732 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:28:02.733 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:28:02.733 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:28:02.733 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:28:02.733 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:28:02.734 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:28:02.734 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/balancer 2026-02-17T08:28:02.735 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:28:02.735 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:02.735 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:02.736 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37242 2026-02-17T08:28:02.736 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:28:02.736 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:28:02.736 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/balancer 2026-02-17T08:28:02.737 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:28:02.737 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:02.737 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:02.738 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37242 2026-02-17T08:28:02.738 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:28:02.739 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T08:28:02.740 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T08:28:02.740 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:28:02.740 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/balancer 1' TERM HUP INT 2026-02-17T08:28:02.740 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:41: TEST_balancer: run_mon td/balancer a 2026-02-17T08:28:02.740 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/balancer 2026-02-17T08:28:02.740 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:28:02.740 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:28:02.740 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:28:02.740 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/balancer/a 2026-02-17T08:28:02.740 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/balancer/a --run-dir=td/balancer 2026-02-17T08:28:02.765 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:28:02.766 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:02.766 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:02.766 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:02.766 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:02.766 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:02.766 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:02.766 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/balancer/a '--log-file=td/balancer/$name.log' '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --mon-cluster-log-file=td/balancer/log --run-dir=td/balancer '--pid-file=td/balancer/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:28:02.790 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:28:02.792 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:28:02.792 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:28:02.792 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:28:02.792 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:28:02.793 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:28:02.793 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:28:02.793 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:28:02.793 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:28:02.793 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:28:02.793 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:02.793 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:02.793 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37242/ceph-mon.a.asok 2026-02-17T08:28:02.793 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:28:02.793 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37242/ceph-mon.a.asok config get fsid 2026-02-17T08:28:02.837 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:28:02.837 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:28:02.837 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:28:02.838 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:28:02.838 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:28:02.838 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:28:02.838 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:28:02.838 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:28:02.838 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:28:02.838 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:02.838 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:02.838 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37242/ceph-mon.a.asok 2026-02-17T08:28:02.838 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:28:02.838 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37242/ceph-mon.a.asok config get mon_host 2026-02-17T08:28:02.881 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:42: TEST_balancer: run_mgr td/balancer x 2026-02-17T08:28:02.881 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/balancer 2026-02-17T08:28:02.881 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:28:02.881 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:28:02.882 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:28:02.882 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/balancer/x 2026-02-17T08:28:02.882 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:28:02.978 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:28:02.978 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:02.978 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:02.979 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:02.979 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:02.979 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:02.979 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:02.979 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:28:02.980 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/balancer/x '--log-file=td/balancer/$name.log' '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --run-dir=td/balancer '--pid-file=td/balancer/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:28:02.998 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:43: TEST_balancer: run_osd td/balancer 0 2026-02-17T08:28:02.998 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/balancer 2026-02-17T08:28:02.998 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:28:02.998 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:28:02.998 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:28:02.998 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/balancer/0 2026-02-17T08:28:02.998 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 ' 2026-02-17T08:28:02.998 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/balancer/0' 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/balancer/0/journal' 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/balancer' 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:02.999 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/balancer/$name.log' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/balancer/$name.pid' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:28:03.000 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:28:03.001 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:28:03.001 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/balancer/0 2026-02-17T08:28:03.001 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:28:03.001 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=899ea593-f61d-49bd-929b-64be17042cee 2026-02-17T08:28:03.001 INFO:tasks.workunit.client.0.trial072.stdout:add osd0 899ea593-f61d-49bd-929b-64be17042cee 2026-02-17T08:28:03.002 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 899ea593-f61d-49bd-929b-64be17042cee' 2026-02-17T08:28:03.002 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:28:03.010 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCTJpRp2JWGABAAl6K4Ty5i8wfmlyLEbidNLA== 2026-02-17T08:28:03.010 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCTJpRp2JWGABAAl6K4Ty5i8wfmlyLEbidNLA=="}' 2026-02-17T08:28:03.010 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 899ea593-f61d-49bd-929b-64be17042cee -i td/balancer/0/new.json 2026-02-17T08:28:03.112 INFO:tasks.workunit.client.0.trial072.stdout:0 2026-02-17T08:28:03.118 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/balancer/0/new.json 2026-02-17T08:28:03.119 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/0 --osd-journal=td/balancer/0/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCTJpRp2JWGABAAl6K4Ty5i8wfmlyLEbidNLA== --osd-uuid 899ea593-f61d-49bd-929b-64be17042cee 2026-02-17T08:28:03.136 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:03.135+0000 7f2bb3c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:03.137 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:03.137+0000 7f2bb3c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:03.138 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:03.138+0000 7f2bb3c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:03.139 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:03.138+0000 7f2bb3c13780 -1 bdev(0x564ab4b6dc00 td/balancer/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:28:03.139 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:03.138+0000 7f2bb3c13780 -1 bluestore(td/balancer/0) _read_fsid unparsable uuid 2026-02-17T08:28:06.021 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/balancer/0/keyring 2026-02-17T08:28:06.022 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:28:06.022 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:28:06.023 INFO:tasks.workunit.client.0.trial072.stdout:adding osd0 key to auth repository 2026-02-17T08:28:06.023 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/balancer/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:28:06.277 INFO:tasks.workunit.client.0.trial072.stdout:start osd.0 2026-02-17T08:28:06.278 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:28:06.278 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/0 --osd-journal=td/balancer/0/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:28:06.279 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:28:06.279 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:28:06.279 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:28:06.294 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:06.292+0000 7fa1c4220780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:06.295 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:06.294+0000 7fa1c4220780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:06.296 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:06.295+0000 7fa1c4220780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:06.469 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:28:06.469 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:28:06.469 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:28:06.470 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:28:06.470 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:28:06.470 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:06.470 INFO:tasks.workunit.client.0.trial072.stdout:0 2026-02-17T08:28:06.471 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:28:06.471 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:06.471 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:06.659 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:07.661 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:07.661 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:07.661 INFO:tasks.workunit.client.0.trial072.stdout:1 2026-02-17T08:28:07.662 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:28:07.662 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:07.662 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:07.850 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:07.885 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:07.883+0000 7fa1c4220780 -1 Falling back to public interface 2026-02-17T08:28:08.851 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:08.851 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:08.851 INFO:tasks.workunit.client.0.trial072.stdout:2 2026-02-17T08:28:08.852 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:28:08.852 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:08.852 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:09.037 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:10.038 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:10.038 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:10.038 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:28:10.039 INFO:tasks.workunit.client.0.trial072.stdout:3 2026-02-17T08:28:10.039 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:10.039 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:10.228 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:10.825 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:10.824+0000 7fa1c4220780 -1 osd.0 0 log_to_monitors true 2026-02-17T08:28:11.229 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:11.229 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:11.229 INFO:tasks.workunit.client.0.trial072.stdout:4 2026-02-17T08:28:11.229 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:28:11.229 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:11.230 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:11.429 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:12.431 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:12.431 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:12.431 INFO:tasks.workunit.client.0.trial072.stdout:5 2026-02-17T08:28:12.432 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:28:12.432 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:12.432 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:12.620 INFO:tasks.workunit.client.0.trial072.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1317803173,v1:127.0.0.1:6803/1317803173] [v2:127.0.0.1:6804/1317803173,v1:127.0.0.1:6805/1317803173] exists,up 899ea593-f61d-49bd-929b-64be17042cee 2026-02-17T08:28:12.624 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:28:12.624 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:28:12.624 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:28:12.624 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:44: TEST_balancer: run_osd td/balancer 1 2026-02-17T08:28:12.624 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/balancer 2026-02-17T08:28:12.624 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:28:12.624 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/balancer/1 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 ' 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/balancer/1' 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/balancer/1/journal' 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/balancer' 2026-02-17T08:28:12.625 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:28:12.626 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:12.626 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:12.626 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:12.626 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:12.626 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:12.626 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:12.626 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:12.626 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:28:12.626 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:28:12.626 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:28:12.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/balancer/$name.log' 2026-02-17T08:28:12.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/balancer/$name.pid' 2026-02-17T08:28:12.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:28:12.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:28:12.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:28:12.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:28:12.628 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:28:12.628 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:28:12.628 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/balancer/1 2026-02-17T08:28:12.628 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:28:12.628 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=948325d9-8df9-44b6-a726-d0014f650042 2026-02-17T08:28:12.628 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 948325d9-8df9-44b6-a726-d0014f650042' 2026-02-17T08:28:12.629 INFO:tasks.workunit.client.0.trial072.stdout:add osd1 948325d9-8df9-44b6-a726-d0014f650042 2026-02-17T08:28:12.629 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:28:12.634 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCcJpRp0KvFJRAAuZFpaOFr0heYIeKXlm/SNg== 2026-02-17T08:28:12.634 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCcJpRp0KvFJRAAuZFpaOFr0heYIeKXlm/SNg=="}' 2026-02-17T08:28:12.634 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 948325d9-8df9-44b6-a726-d0014f650042 -i td/balancer/1/new.json 2026-02-17T08:28:12.829 INFO:tasks.workunit.client.0.trial072.stdout:1 2026-02-17T08:28:12.836 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/balancer/1/new.json 2026-02-17T08:28:12.836 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/1 --osd-journal=td/balancer/1/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCcJpRp0KvFJRAAuZFpaOFr0heYIeKXlm/SNg== --osd-uuid 948325d9-8df9-44b6-a726-d0014f650042 2026-02-17T08:28:12.853 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:12.852+0000 7fb0b380d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:12.855 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:12.853+0000 7fb0b380d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:12.856 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:12.854+0000 7fb0b380d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:12.856 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:12.854+0000 7fb0b380d780 -1 bdev(0x558b7d459c00 td/balancer/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:28:12.857 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:12.854+0000 7fb0b380d780 -1 bluestore(td/balancer/1) _read_fsid unparsable uuid 2026-02-17T08:28:14.998 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/balancer/1/keyring 2026-02-17T08:28:14.998 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:28:14.998 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:28:14.999 INFO:tasks.workunit.client.0.trial072.stdout:adding osd1 key to auth repository 2026-02-17T08:28:14.999 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/balancer/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:28:15.261 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:28:15.262 INFO:tasks.workunit.client.0.trial072.stdout:start osd.1 2026-02-17T08:28:15.262 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/1 --osd-journal=td/balancer/1/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:28:15.262 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:28:15.263 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:28:15.263 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:28:15.278 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:15.278+0000 7f61979b4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:15.280 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:15.279+0000 7f61979b4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:15.281 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:15.280+0000 7f61979b4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:15.449 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:28:15.450 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:28:15.450 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:28:15.450 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:28:15.450 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:28:15.450 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:15.450 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:28:15.451 INFO:tasks.workunit.client.0.trial072.stdout:0 2026-02-17T08:28:15.451 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:15.451 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:15.636 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:16.637 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:16.638 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:16.638 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:28:16.638 INFO:tasks.workunit.client.0.trial072.stdout:1 2026-02-17T08:28:16.639 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:16.639 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:16.826 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:16.867 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:16.866+0000 7f61979b4780 -1 Falling back to public interface 2026-02-17T08:28:17.827 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:17.828 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:17.828 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:28:17.828 INFO:tasks.workunit.client.0.trial072.stdout:2 2026-02-17T08:28:17.829 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:17.829 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:18.015 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:19.016 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:19.016 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:19.016 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:28:19.017 INFO:tasks.workunit.client.0.trial072.stdout:3 2026-02-17T08:28:19.017 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:19.017 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:19.202 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:19.799 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:19.799+0000 7f61979b4780 -1 osd.1 0 log_to_monitors true 2026-02-17T08:28:20.203 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:20.203 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:20.203 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:28:20.204 INFO:tasks.workunit.client.0.trial072.stdout:4 2026-02-17T08:28:20.204 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:20.204 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:20.391 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:21.392 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:21.392 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:21.393 INFO:tasks.workunit.client.0.trial072.stdout:5 2026-02-17T08:28:21.393 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:28:21.393 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:21.393 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:21.577 INFO:tasks.workunit.client.0.trial072.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3545369934,v1:127.0.0.1:6811/3545369934] [v2:127.0.0.1:6812/3545369934,v1:127.0.0.1:6813/3545369934] exists,up 948325d9-8df9-44b6-a726-d0014f650042 2026-02-17T08:28:21.581 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:28:21.581 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:28:21.581 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:28:21.581 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:45: TEST_balancer: run_osd td/balancer 2 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/balancer 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/balancer/2 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 ' 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/balancer/2' 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/balancer/2/journal' 2026-02-17T08:28:21.582 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/balancer' 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:28:21.583 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/balancer/$name.log' 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/balancer/$name.pid' 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/balancer/2 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:28:21.584 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=51978403-be0a-4810-af32-cbc01e5481ae 2026-02-17T08:28:21.585 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 51978403-be0a-4810-af32-cbc01e5481ae' 2026-02-17T08:28:21.585 INFO:tasks.workunit.client.0.trial072.stdout:add osd2 51978403-be0a-4810-af32-cbc01e5481ae 2026-02-17T08:28:21.585 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:28:21.592 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQClJpRpliJAIxAAClIMGjRsz//hq/SEog99hQ== 2026-02-17T08:28:21.593 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQClJpRpliJAIxAAClIMGjRsz//hq/SEog99hQ=="}' 2026-02-17T08:28:21.593 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 51978403-be0a-4810-af32-cbc01e5481ae -i td/balancer/2/new.json 2026-02-17T08:28:21.784 INFO:tasks.workunit.client.0.trial072.stdout:2 2026-02-17T08:28:21.792 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/balancer/2/new.json 2026-02-17T08:28:21.793 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/2 --osd-journal=td/balancer/2/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQClJpRpliJAIxAAClIMGjRsz//hq/SEog99hQ== --osd-uuid 51978403-be0a-4810-af32-cbc01e5481ae 2026-02-17T08:28:21.809 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:21.808+0000 7f00e0a16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:21.810 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:21.810+0000 7f00e0a16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:21.811 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:21.811+0000 7f00e0a16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:21.812 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:21.811+0000 7f00e0a16780 -1 bdev(0x558c5e86dc00 td/balancer/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:28:21.812 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:21.811+0000 7f00e0a16780 -1 bluestore(td/balancer/2) _read_fsid unparsable uuid 2026-02-17T08:28:24.178 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/balancer/2/keyring 2026-02-17T08:28:24.178 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:28:24.178 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:28:24.179 INFO:tasks.workunit.client.0.trial072.stdout:adding osd2 key to auth repository 2026-02-17T08:28:24.179 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/balancer/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:28:24.437 INFO:tasks.workunit.client.0.trial072.stdout:start osd.2 2026-02-17T08:28:24.438 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:28:24.438 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/2 --osd-journal=td/balancer/2/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:28:24.439 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:28:24.439 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:28:24.439 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:28:24.453 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:24.452+0000 7f4807416780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:24.454 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:24.453+0000 7f4807416780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:24.455 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:24.454+0000 7f4807416780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:24.626 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:28:24.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:28:24.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:28:24.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:28:24.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:28:24.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:24.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:28:24.628 INFO:tasks.workunit.client.0.trial072.stdout:0 2026-02-17T08:28:24.628 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:24.628 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:28:24.815 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:25.816 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:25.817 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:25.817 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:28:25.817 INFO:tasks.workunit.client.0.trial072.stdout:1 2026-02-17T08:28:25.818 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:25.818 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:28:26.002 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:26.041 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:26.041+0000 7f4807416780 -1 Falling back to public interface 2026-02-17T08:28:27.003 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:27.003 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:27.004 INFO:tasks.workunit.client.0.trial072.stdout:2 2026-02-17T08:28:27.004 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:28:27.004 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:27.004 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:28:27.192 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:28.193 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:28.193 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:28.194 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:28:28.194 INFO:tasks.workunit.client.0.trial072.stdout:3 2026-02-17T08:28:28.194 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:28.195 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:28:28.383 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:28.989 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:28.988+0000 7f4807416780 -1 osd.2 0 log_to_monitors true 2026-02-17T08:28:29.384 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:29.384 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:29.385 INFO:tasks.workunit.client.0.trial072.stdout:4 2026-02-17T08:28:29.385 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:28:29.385 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:29.385 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:28:29.570 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:30.571 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:30.571 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:30.572 INFO:tasks.workunit.client.0.trial072.stdout:5 2026-02-17T08:28:30.572 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:28:30.572 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:30.573 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:28:30.758 INFO:tasks.workunit.client.0.trial072.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1101885425,v1:127.0.0.1:6819/1101885425] [v2:127.0.0.1:6820/1101885425,v1:127.0.0.1:6821/1101885425] exists,up 51978403-be0a-4810-af32-cbc01e5481ae 2026-02-17T08:28:30.759 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:28:30.759 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:28:30.759 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:28:30.759 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:46: TEST_balancer: create_pool test1 8 2026-02-17T08:28:30.759 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test1 8 2026-02-17T08:28:30.996 INFO:tasks.workunit.client.0.trial072.stderr:pool 'test1' already exists 2026-02-17T08:28:31.003 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:28:32.005 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:47: TEST_balancer: create_pool test2 8 2026-02-17T08:28:32.005 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test2 8 2026-02-17T08:28:32.245 INFO:tasks.workunit.client.0.trial072.stderr:pool 'test2' already exists 2026-02-17T08:28:32.253 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:28:33.255 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:49: TEST_balancer: wait_for_clean 2026-02-17T08:28:33.255 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:28:33.255 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:28:33.256 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:28:33.257 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:28:33.257 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:28:33.257 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:28:33.257 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:28:33.257 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:28:33.257 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:28:33.340 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:28:33.340 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:28:33.340 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:28:33.340 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:28:33.340 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:28:33.340 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:28:33.528 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:28:33.528 INFO:tasks.workunit.client.0.trial072.stderr:1 2026-02-17T08:28:33.528 INFO:tasks.workunit.client.0.trial072.stderr:2' 2026-02-17T08:28:33.528 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:28:33.528 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:28:33.528 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:28:33.591 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836487 2026-02-17T08:28:33.591 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836487 2026-02-17T08:28:33.591 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T08:28:33.592 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:28:33.592 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:28:33.653 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672965 2026-02-17T08:28:33.653 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672965 2026-02-17T08:28:33.653 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-42949672965' 2026-02-17T08:28:33.653 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:28:33.653 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:28:33.715 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542147 2026-02-17T08:28:33.715 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542147 2026-02-17T08:28:33.716 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-42949672965 2-60129542147' 2026-02-17T08:28:33.716 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:28:33.716 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836487 2026-02-17T08:28:33.716 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:28:33.717 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:28:33.718 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836487 2026-02-17T08:28:33.718 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:28:33.719 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836487 2026-02-17T08:28:33.719 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T08:28:33.719 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.0 seq 21474836487 2026-02-17T08:28:33.719 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:28:33.912 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T08:28:33.912 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:28:34.913 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:28:34.913 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:28:35.103 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T08:28:35.104 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:28:36.104 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:28:36.105 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:28:36.297 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T08:28:36.297 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:28:36.298 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672965 2026-02-17T08:28:36.298 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:28:36.298 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:28:36.299 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672965 2026-02-17T08:28:36.299 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:28:36.300 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672965 2026-02-17T08:28:36.300 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2026-02-17T08:28:36.301 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.1 seq 42949672965 2026-02-17T08:28:36.301 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:28:36.486 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672965 -lt 42949672965 2026-02-17T08:28:36.487 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:28:36.487 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542147 2026-02-17T08:28:36.487 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:28:36.488 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:28:36.489 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542147 2026-02-17T08:28:36.489 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:28:36.490 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542147 2026-02-17T08:28:36.490 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T08:28:36.490 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.2 seq 60129542147 2026-02-17T08:28:36.491 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:28:36.678 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542148 -lt 60129542147 2026-02-17T08:28:36.679 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:28:36.679 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:28:36.679 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:28:36.927 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 == 0 2026-02-17T08:28:36.927 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:28:36.928 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:28:36.928 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:28:36.928 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:28:36.928 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:28:36.928 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:28:36.928 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:28:37.112 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=16 2026-02-17T08:28:37.112 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:28:37.113 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:28:37.113 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:28:37.364 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 16 = 16 2026-02-17T08:28:37.364 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:28:37.364 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:28:37.364 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:51: TEST_balancer: ceph pg dump pgs 2026-02-17T08:28:37.540 INFO:tasks.workunit.client.0.trial072.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T08:28:37.540 INFO:tasks.workunit.client.0.trial072.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:31.053564+0000 0'0 20:18 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:28:30.945926+0000 0'0 2026-02-17T08:28:30.945926+0000 0 0 periodic scrub scheduled @ 2026-02-18T18:06:17.691422+0000 0 0 2026-02-17T08:28:37.541 INFO:tasks.workunit.client.0.trial072.stdout:2.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:32.303320+0000 0'0 20:13 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T08:28:32.193211+0000 0'0 2026-02-17T08:28:32.193211+0000 0 0 periodic scrub scheduled @ 2026-02-18T09:48:58.118676+0000 0 0 2026-02-17T08:28:37.541 INFO:tasks.workunit.client.0.trial072.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:31.055332+0000 0'0 20:19 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T08:28:30.945926+0000 0'0 2026-02-17T08:28:30.945926+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:53:18.023459+0000 0 0 2026-02-17T08:28:37.541 INFO:tasks.workunit.client.0.trial072.stdout:2.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:32.302971+0000 0'0 20:13 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T08:28:32.193211+0000 0'0 2026-02-17T08:28:32.193211+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:22:59.520597+0000 0 0 2026-02-17T08:28:37.541 INFO:tasks.workunit.client.0.trial072.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:31.054350+0000 0'0 20:19 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T08:28:30.945926+0000 0'0 2026-02-17T08:28:30.945926+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:32:07.888218+0000 0 0 2026-02-17T08:28:37.541 INFO:tasks.workunit.client.0.trial072.stdout:2.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:32.302823+0000 0'0 20:13 [2,1,0] 2 [2,1,0] 2 0'0 2026-02-17T08:28:32.193211+0000 0'0 2026-02-17T08:28:32.193211+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:03:07.401155+0000 0 0 2026-02-17T08:28:37.541 INFO:tasks.workunit.client.0.trial072.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:31.054643+0000 0'0 20:18 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T08:28:30.945926+0000 0'0 2026-02-17T08:28:30.945926+0000 0 0 periodic scrub scheduled @ 2026-02-18T11:08:43.091239+0000 0 0 2026-02-17T08:28:37.541 INFO:tasks.workunit.client.0.trial072.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:32.302011+0000 0'0 20:13 [2,1,0] 2 [2,1,0] 2 0'0 2026-02-17T08:28:32.193211+0000 0'0 2026-02-17T08:28:32.193211+0000 0 0 periodic scrub scheduled @ 2026-02-18T18:59:30.502608+0000 0 0 2026-02-17T08:28:37.541 INFO:tasks.workunit.client.0.trial072.stdout:2.7 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:32.303312+0000 0'0 20:13 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:28:32.193211+0000 0'0 2026-02-17T08:28:32.193211+0000 0 0 periodic scrub scheduled @ 2026-02-18T18:07:34.511140+0000 0 0 2026-02-17T08:28:37.541 INFO:tasks.workunit.client.0.trial072.stdout:1.4 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:31.054520+0000 0'0 20:18 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:28:30.945926+0000 0'0 2026-02-17T08:28:30.945926+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:58:48.967823+0000 0 0 2026-02-17T08:28:37.541 INFO:tasks.workunit.client.0.trial072.stdout:2.6 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:32.303314+0000 0'0 20:13 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:28:32.193211+0000 0'0 2026-02-17T08:28:32.193211+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:48:48.457137+0000 0 0 2026-02-17T08:28:37.542 INFO:tasks.workunit.client.0.trial072.stdout:1.5 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:31.055538+0000 0'0 20:19 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T08:28:30.945926+0000 0'0 2026-02-17T08:28:30.945926+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:52:10.130551+0000 0 0 2026-02-17T08:28:37.542 INFO:tasks.workunit.client.0.trial072.stdout:2.5 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:32.303330+0000 0'0 20:13 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:28:32.193211+0000 0'0 2026-02-17T08:28:32.193211+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:03:17.490685+0000 0 0 2026-02-17T08:28:37.542 INFO:tasks.workunit.client.0.trial072.stdout:1.6 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:31.054673+0000 0'0 20:18 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:28:30.945926+0000 0'0 2026-02-17T08:28:30.945926+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:24:46.032117+0000 0 0 2026-02-17T08:28:37.542 INFO:tasks.workunit.client.0.trial072.stdout:1.7 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:31.054805+0000 0'0 20:18 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T08:28:30.945926+0000 0'0 2026-02-17T08:28:30.945926+0000 0 0 periodic scrub scheduled @ 2026-02-18T18:33:56.920464+0000 0 0 2026-02-17T08:28:37.542 INFO:tasks.workunit.client.0.trial072.stdout:2.4 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:32.303322+0000 0'0 20:13 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:28:32.193211+0000 0'0 2026-02-17T08:28:32.193211+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:44:29.355712+0000 0 0 2026-02-17T08:28:37.542 INFO:tasks.workunit.client.0.trial072.stdout: 2026-02-17T08:28:37.542 INFO:tasks.workunit.client.0.trial072.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T08:28:37.542 INFO:tasks.workunit.client.0.trial072.stderr:dumped pgs 2026-02-17T08:28:37.546 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:52: TEST_balancer: ceph balancer status 2026-02-17T08:28:37.738 INFO:tasks.workunit.client.0.trial072.stdout:{ 2026-02-17T08:28:37.738 INFO:tasks.workunit.client.0.trial072.stdout: "active": true, 2026-02-17T08:28:37.738 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_duration": "0:00:00.000416", 2026-02-17T08:28:37.738 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_started": "Tue Feb 17 08:28:05 2026", 2026-02-17T08:28:37.738 INFO:tasks.workunit.client.0.trial072.stdout: "mode": "upmap", 2026-02-17T08:28:37.738 INFO:tasks.workunit.client.0.trial072.stdout: "no_optimization_needed": false, 2026-02-17T08:28:37.738 INFO:tasks.workunit.client.0.trial072.stdout: "optimize_result": "No pools available", 2026-02-17T08:28:37.738 INFO:tasks.workunit.client.0.trial072.stdout: "plans": [] 2026-02-17T08:28:37.739 INFO:tasks.workunit.client.0.trial072.stdout:} 2026-02-17T08:28:37.745 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:53: TEST_balancer: ceph balancer status 2026-02-17T08:28:37.745 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:53: TEST_balancer: jq .mode 2026-02-17T08:28:37.935 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:53: TEST_balancer: eval 'MODE="upmap"' 2026-02-17T08:28:37.935 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:53: TEST_balancer: MODE=upmap 2026-02-17T08:28:37.935 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:54: TEST_balancer: test upmap = upmap 2026-02-17T08:28:37.936 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:55: TEST_balancer: ceph balancer status 2026-02-17T08:28:37.936 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:55: TEST_balancer: jq .active 2026-02-17T08:28:38.125 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:55: TEST_balancer: ACTIVE=true 2026-02-17T08:28:38.125 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:56: TEST_balancer: test true = true 2026-02-17T08:28:38.125 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:58: TEST_balancer: ceph balancer ls 2026-02-17T08:28:38.305 INFO:tasks.workunit.client.0.trial072.stdout:[] 2026-02-17T08:28:38.312 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:59: TEST_balancer: ceph balancer ls 2026-02-17T08:28:38.501 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:59: TEST_balancer: PLANS='[]' 2026-02-17T08:28:38.501 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:60: TEST_balancer: test '[]' = '[]' 2026-02-17T08:28:38.501 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:61: TEST_balancer: ceph balancer eval 2026-02-17T08:28:38.683 INFO:tasks.workunit.client.0.trial072.stdout:current cluster score 0.000000 (lower is better) 2026-02-17T08:28:38.684 INFO:tasks.workunit.client.0.trial072.stdout:read_balance_scores (lower is better) {'test1': 1.8799999952316284, 'test2': 1.8799999952316284} 2026-02-17T08:28:38.691 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:62: TEST_balancer: ceph balancer eval 2026-02-17T08:28:38.879 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:62: TEST_balancer: EVAL='current cluster score 0.000000 (lower is better) 2026-02-17T08:28:38.880 INFO:tasks.workunit.client.0.trial072.stderr:read_balance_scores (lower is better) {'\''test1'\'': 1.8799999952316284, '\''test2'\'': 1.8799999952316284}' 2026-02-17T08:28:38.880 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:63: TEST_balancer: test 'current cluster score 0.000000 (lower is better) 2026-02-17T08:28:38.880 INFO:tasks.workunit.client.0.trial072.stderr:read_balance_scores (lower is better) {'\''test1'\'': 1.8799999952316284, '\''test2'\'': 1.8799999952316284}' = 'current cluster score 0.000000 (lower is better)' 2026-02-17T08:28:38.880 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:64: TEST_balancer: ceph balancer eval-verbose 2026-02-17T08:28:39.064 INFO:tasks.workunit.client.0.trial072.stdout:current cluster 2026-02-17T08:28:39.064 INFO:tasks.workunit.client.0.trial072.stdout:target_by_root {'default': {0: 0.3333333333333333, 1: 0.3333333333333333, 2: 0.3333333333333333}} 2026-02-17T08:28:39.064 INFO:tasks.workunit.client.0.trial072.stdout:actual_by_pool {'test1': {'pgs': {1: 0.3333333333333333, 0: 0.3333333333333333, 2: 0.3333333333333333}, 'objects': {1: 0.0, 0: 0.0, 2: 0.0}, 'bytes': {1: 0.0, 0: 0.0, 2: 0.0}}, 'test2': {'pgs': {2: 0.3333333333333333, 1: 0.3333333333333333, 0: 0.3333333333333333}, 'objects': {2: 0.0, 1: 0.0, 0: 0.0}, 'bytes': {2: 0.0, 1: 0.0, 0: 0.0}}} 2026-02-17T08:28:39.064 INFO:tasks.workunit.client.0.trial072.stdout:actual_by_root {'default': {'pgs': {0: 0.3333333333333333, 1: 0.3333333333333333, 2: 0.3333333333333333}, 'objects': {0: 0.0, 1: 0.0, 2: 0.0}, 'bytes': {0: 0.0, 1: 0.0, 2: 0.0}}} 2026-02-17T08:28:39.064 INFO:tasks.workunit.client.0.trial072.stdout:count_by_pool {'test1': {'pgs': {1: 8, 0: 8, 2: 8}, 'objects': {1: 0, 0: 0, 2: 0}, 'bytes': {1: 0, 0: 0, 2: 0}}, 'test2': {'pgs': {2: 8, 1: 8, 0: 8}, 'objects': {2: 0, 1: 0, 0: 0}, 'bytes': {2: 0, 1: 0, 0: 0}}} 2026-02-17T08:28:39.064 INFO:tasks.workunit.client.0.trial072.stdout:count_by_root {'default': {'pgs': {0: 16.0, 1: 16.0, 2: 16.0}, 'objects': {0: 0.0, 1: 0.0, 2: 0.0}, 'bytes': {0: 0.0, 1: 0.0, 2: 0.0}}} 2026-02-17T08:28:39.065 INFO:tasks.workunit.client.0.trial072.stdout:total_by_pool {'test1': {'pgs': 24, 'objects': 0, 'bytes': 0}, 'test2': {'pgs': 24, 'objects': 0, 'bytes': 0}} 2026-02-17T08:28:39.065 INFO:tasks.workunit.client.0.trial072.stdout:total_by_root {'default': {'pgs': 48, 'objects': 0, 'bytes': 0}} 2026-02-17T08:28:39.065 INFO:tasks.workunit.client.0.trial072.stdout:stats_by_root {'default': {'pgs': {'max': 16.0, 'min': 16.0, 'avg': 16.0, 'stddev': 0.0, 'sum_weight': 0.0, 'score': 0.0}, 'objects': {'max': 0, 'min': 0, 'avg': 0, 'stddev': 0, 'sum_weight': 0, 'score': 0}, 'bytes': {'max': 0, 'min': 0, 'avg': 0, 'stddev': 0, 'sum_weight': 0, 'score': 0}}} 2026-02-17T08:28:39.065 INFO:tasks.workunit.client.0.trial072.stdout:score_by_pool {} 2026-02-17T08:28:39.065 INFO:tasks.workunit.client.0.trial072.stdout:score_by_root {'default': {'pgs': 0.0, 'objects': 0, 'bytes': 0}} 2026-02-17T08:28:39.065 INFO:tasks.workunit.client.0.trial072.stdout:score 0.000000 (lower is better) 2026-02-17T08:28:39.065 INFO:tasks.workunit.client.0.trial072.stdout:read_balance_score_by_pool {'test1': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1.0, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1.0, 'average_primary_affinity': 1.0, 'average_primary_affinity_weighted': 1.0}, 'test2': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1.0, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1.0, 'average_primary_affinity': 1.0, 'average_primary_affinity_weighted': 1.0}} 2026-02-17T08:28:39.071 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:66: TEST_balancer: ceph balancer pool add test1 2026-02-17T08:28:39.263 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:67: TEST_balancer: ceph balancer pool add test2 2026-02-17T08:28:39.457 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:68: TEST_balancer: ceph balancer pool ls 2026-02-17T08:28:39.640 INFO:tasks.workunit.client.0.trial072.stdout:[ 2026-02-17T08:28:39.640 INFO:tasks.workunit.client.0.trial072.stdout: "test1", 2026-02-17T08:28:39.640 INFO:tasks.workunit.client.0.trial072.stdout: "test2" 2026-02-17T08:28:39.640 INFO:tasks.workunit.client.0.trial072.stdout:] 2026-02-17T08:28:39.647 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:69: TEST_balancer: ceph balancer pool ls 2026-02-17T08:28:39.647 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:69: TEST_balancer: jq 'sort | .[0]' 2026-02-17T08:28:39.836 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:69: TEST_balancer: eval 'POOL="test1"' 2026-02-17T08:28:39.836 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:69: TEST_balancer: POOL=test1 2026-02-17T08:28:39.837 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:70: TEST_balancer: test test1 = test1 2026-02-17T08:28:39.837 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:71: TEST_balancer: ceph balancer pool ls 2026-02-17T08:28:39.837 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:71: TEST_balancer: jq 'sort | .[1]' 2026-02-17T08:28:40.025 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:71: TEST_balancer: eval 'POOL="test2"' 2026-02-17T08:28:40.026 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:71: TEST_balancer: POOL=test2 2026-02-17T08:28:40.026 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:72: TEST_balancer: test test2 = test2 2026-02-17T08:28:40.026 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:73: TEST_balancer: ceph balancer pool rm test1 2026-02-17T08:28:40.221 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:74: TEST_balancer: ceph balancer pool rm test2 2026-02-17T08:28:40.413 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:75: TEST_balancer: ceph balancer pool ls 2026-02-17T08:28:40.601 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:76: TEST_balancer: ceph balancer pool add test1 2026-02-17T08:28:40.798 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:78: TEST_balancer: ceph balancer mode crush-compat 2026-02-17T08:28:41.003 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:79: TEST_balancer: ceph balancer status 2026-02-17T08:28:41.182 INFO:tasks.workunit.client.0.trial072.stdout:{ 2026-02-17T08:28:41.182 INFO:tasks.workunit.client.0.trial072.stdout: "active": true, 2026-02-17T08:28:41.182 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_duration": "0:00:00.000416", 2026-02-17T08:28:41.182 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_started": "Tue Feb 17 08:28:05 2026", 2026-02-17T08:28:41.182 INFO:tasks.workunit.client.0.trial072.stdout: "mode": "crush-compat", 2026-02-17T08:28:41.182 INFO:tasks.workunit.client.0.trial072.stdout: "no_optimization_needed": false, 2026-02-17T08:28:41.182 INFO:tasks.workunit.client.0.trial072.stdout: "optimize_result": "No pools available", 2026-02-17T08:28:41.183 INFO:tasks.workunit.client.0.trial072.stdout: "plans": [] 2026-02-17T08:28:41.183 INFO:tasks.workunit.client.0.trial072.stdout:} 2026-02-17T08:28:41.190 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:80: TEST_balancer: ceph balancer status 2026-02-17T08:28:41.190 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:80: TEST_balancer: jq .mode 2026-02-17T08:28:41.376 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:80: TEST_balancer: eval 'MODE="crush-compat"' 2026-02-17T08:28:41.376 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:80: TEST_balancer: MODE=crush-compat 2026-02-17T08:28:41.376 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:81: TEST_balancer: test crush-compat = crush-compat 2026-02-17T08:28:41.376 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:82: TEST_balancer: ceph balancer off 2026-02-17T08:28:41.564 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:83: TEST_balancer: ceph balancer optimize plan_crush test1 2026-02-17T08:28:41.699 INFO:tasks.workunit.client.0.trial072.stderr:Error EALREADY: Distribution is already perfect 2026-02-17T08:28:41.702 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:84: TEST_balancer: ceph balancer status 2026-02-17T08:28:41.885 INFO:tasks.workunit.client.0.trial072.stdout:{ 2026-02-17T08:28:41.885 INFO:tasks.workunit.client.0.trial072.stdout: "active": false, 2026-02-17T08:28:41.885 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_duration": "0:00:00.000316", 2026-02-17T08:28:41.885 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_started": "Tue Feb 17 08:28:41 2026", 2026-02-17T08:28:41.885 INFO:tasks.workunit.client.0.trial072.stdout: "mode": "crush-compat", 2026-02-17T08:28:41.885 INFO:tasks.workunit.client.0.trial072.stdout: "no_optimization_needed": false, 2026-02-17T08:28:41.886 INFO:tasks.workunit.client.0.trial072.stdout: "optimize_result": "Distribution is already perfect", 2026-02-17T08:28:41.886 INFO:tasks.workunit.client.0.trial072.stdout: "plans": [] 2026-02-17T08:28:41.886 INFO:tasks.workunit.client.0.trial072.stdout:} 2026-02-17T08:28:41.893 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:85: TEST_balancer: ceph balancer status 2026-02-17T08:28:41.893 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:85: TEST_balancer: jq .optimize_result 2026-02-17T08:28:42.085 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:85: TEST_balancer: eval 'RESULT="Distribution' is already 'perfect"' 2026-02-17T08:28:42.085 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:85: TEST_balancer: RESULT='Distribution is already perfect' 2026-02-17T08:28:42.085 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:86: TEST_balancer: test 'Distribution is already perfect' = 'Distribution is already perfect' 2026-02-17T08:28:42.085 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:88: TEST_balancer: ceph balancer on 2026-02-17T08:28:42.278 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:89: TEST_balancer: ceph balancer status 2026-02-17T08:28:42.279 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:89: TEST_balancer: jq .active 2026-02-17T08:28:42.469 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:89: TEST_balancer: ACTIVE=true 2026-02-17T08:28:42.469 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:90: TEST_balancer: test true = true 2026-02-17T08:28:42.469 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:91: TEST_balancer: sleep 2 2026-02-17T08:28:44.470 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:92: TEST_balancer: ceph balancer status 2026-02-17T08:28:44.652 INFO:tasks.workunit.client.0.trial072.stdout:{ 2026-02-17T08:28:44.653 INFO:tasks.workunit.client.0.trial072.stdout: "active": true, 2026-02-17T08:28:44.653 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_duration": "0:00:00.000272", 2026-02-17T08:28:44.653 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_started": "Tue Feb 17 08:28:42 2026", 2026-02-17T08:28:44.653 INFO:tasks.workunit.client.0.trial072.stdout: "mode": "crush-compat", 2026-02-17T08:28:44.653 INFO:tasks.workunit.client.0.trial072.stdout: "no_optimization_needed": false, 2026-02-17T08:28:44.653 INFO:tasks.workunit.client.0.trial072.stdout: "optimize_result": "Distribution is already perfect", 2026-02-17T08:28:44.653 INFO:tasks.workunit.client.0.trial072.stdout: "plans": [] 2026-02-17T08:28:44.653 INFO:tasks.workunit.client.0.trial072.stdout:} 2026-02-17T08:28:44.659 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:93: TEST_balancer: ceph balancer off 2026-02-17T08:28:44.849 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:94: TEST_balancer: ceph balancer status 2026-02-17T08:28:44.849 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:94: TEST_balancer: jq .active 2026-02-17T08:28:45.036 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:94: TEST_balancer: ACTIVE=false 2026-02-17T08:28:45.036 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:95: TEST_balancer: test false = false 2026-02-17T08:28:45.036 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:96: TEST_balancer: sleep 2 2026-02-17T08:28:47.037 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:98: TEST_balancer: ceph balancer reset 2026-02-17T08:28:47.228 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:100: TEST_balancer: ceph balancer mode upmap 2026-02-17T08:28:47.419 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:101: TEST_balancer: ceph balancer status 2026-02-17T08:28:47.604 INFO:tasks.workunit.client.0.trial072.stdout:{ 2026-02-17T08:28:47.604 INFO:tasks.workunit.client.0.trial072.stdout: "active": false, 2026-02-17T08:28:47.604 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_duration": "0:00:00.000272", 2026-02-17T08:28:47.604 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_started": "Tue Feb 17 08:28:42 2026", 2026-02-17T08:28:47.604 INFO:tasks.workunit.client.0.trial072.stdout: "mode": "upmap", 2026-02-17T08:28:47.604 INFO:tasks.workunit.client.0.trial072.stdout: "no_optimization_needed": false, 2026-02-17T08:28:47.604 INFO:tasks.workunit.client.0.trial072.stdout: "optimize_result": "Distribution is already perfect", 2026-02-17T08:28:47.605 INFO:tasks.workunit.client.0.trial072.stdout: "plans": [] 2026-02-17T08:28:47.605 INFO:tasks.workunit.client.0.trial072.stdout:} 2026-02-17T08:28:47.613 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:102: TEST_balancer: ceph balancer status 2026-02-17T08:28:47.613 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:102: TEST_balancer: jq .mode 2026-02-17T08:28:47.799 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:102: TEST_balancer: eval 'MODE="upmap"' 2026-02-17T08:28:47.800 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:102: TEST_balancer: MODE=upmap 2026-02-17T08:28:47.800 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:103: TEST_balancer: test upmap = upmap 2026-02-17T08:28:47.800 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:104: TEST_balancer: ceph balancer optimize plan_upmap 2026-02-17T08:28:47.934 INFO:tasks.workunit.client.0.trial072.stderr:Error EALREADY: Unable to find further optimization, or pool(s) pg_num is decreasing, or distribution is already perfect 2026-02-17T08:28:47.937 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:105: TEST_balancer: ceph balancer status 2026-02-17T08:28:48.117 INFO:tasks.workunit.client.0.trial072.stdout:{ 2026-02-17T08:28:48.117 INFO:tasks.workunit.client.0.trial072.stdout: "active": false, 2026-02-17T08:28:48.118 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_duration": "0:00:00.000263", 2026-02-17T08:28:48.118 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_started": "Tue Feb 17 08:28:47 2026", 2026-02-17T08:28:48.118 INFO:tasks.workunit.client.0.trial072.stdout: "mode": "upmap", 2026-02-17T08:28:48.118 INFO:tasks.workunit.client.0.trial072.stdout: "no_optimization_needed": true, 2026-02-17T08:28:48.118 INFO:tasks.workunit.client.0.trial072.stdout: "optimize_result": "Unable to find further optimization, or pool(s) pg_num is decreasing, or distribution is already perfect", 2026-02-17T08:28:48.118 INFO:tasks.workunit.client.0.trial072.stdout: "plans": [] 2026-02-17T08:28:48.118 INFO:tasks.workunit.client.0.trial072.stdout:} 2026-02-17T08:28:48.125 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:106: TEST_balancer: ceph balancer status 2026-02-17T08:28:48.125 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:106: TEST_balancer: jq .optimize_result 2026-02-17T08:28:48.311 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:106: TEST_balancer: eval 'RESULT="Unable' to find further optimization, or 'pool(s)' pg_num is decreasing, or distribution is already 'perfect"' 2026-02-17T08:28:48.311 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:106: TEST_balancer: RESULT='Unable to find further optimization, or pool(s) pg_num is decreasing, or distribution is already perfect' 2026-02-17T08:28:48.312 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:107: TEST_balancer: test 'Unable to find further optimization, or pool(s) pg_num is decreasing, or distribution is already perfect' = 'Unable to find further optimization, or pool(s) pg_num is decreasing, or distribution is already perfect' 2026-02-17T08:28:48.312 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:109: TEST_balancer: ceph balancer on 2026-02-17T08:28:48.503 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:110: TEST_balancer: ceph balancer status 2026-02-17T08:28:48.503 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:110: TEST_balancer: jq .active 2026-02-17T08:28:48.693 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:110: TEST_balancer: ACTIVE=true 2026-02-17T08:28:48.693 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:111: TEST_balancer: test true = true 2026-02-17T08:28:48.693 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:112: TEST_balancer: sleep 2 2026-02-17T08:28:50.694 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:113: TEST_balancer: ceph balancer status 2026-02-17T08:28:50.878 INFO:tasks.workunit.client.0.trial072.stdout:{ 2026-02-17T08:28:50.878 INFO:tasks.workunit.client.0.trial072.stdout: "active": true, 2026-02-17T08:28:50.878 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_duration": "0:00:00.000116", 2026-02-17T08:28:50.878 INFO:tasks.workunit.client.0.trial072.stdout: "last_optimize_started": "Tue Feb 17 08:28:48 2026", 2026-02-17T08:28:50.879 INFO:tasks.workunit.client.0.trial072.stdout: "mode": "upmap", 2026-02-17T08:28:50.879 INFO:tasks.workunit.client.0.trial072.stdout: "no_optimization_needed": true, 2026-02-17T08:28:50.879 INFO:tasks.workunit.client.0.trial072.stdout: "optimize_result": "Unable to find further optimization, or pool(s) pg_num is decreasing, or distribution is already perfect", 2026-02-17T08:28:50.879 INFO:tasks.workunit.client.0.trial072.stdout: "plans": [] 2026-02-17T08:28:50.879 INFO:tasks.workunit.client.0.trial072.stdout:} 2026-02-17T08:28:50.885 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:114: TEST_balancer: ceph balancer off 2026-02-17T08:28:51.079 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:115: TEST_balancer: ceph balancer status 2026-02-17T08:28:51.079 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:115: TEST_balancer: jq .active 2026-02-17T08:28:51.267 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:115: TEST_balancer: ACTIVE=false 2026-02-17T08:28:51.267 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:116: TEST_balancer: test false = false 2026-02-17T08:28:51.267 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:118: TEST_balancer: teardown td/balancer 2026-02-17T08:28:51.267 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/balancer 2026-02-17T08:28:51.267 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:28:51.268 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/balancer KILL 2026-02-17T08:28:51.268 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:28:51.268 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:28:51.268 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:28:51.268 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:28:51.268 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:28:51.374 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:28:51.375 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:28:51.376 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:28:51.376 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:28:51.378 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:28:51.378 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:28:51.378 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:28:51.378 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:28:51.379 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:28:51.379 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:28:51.379 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:28:51.380 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:28:51.381 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:28:51.381 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/balancer 2026-02-17T08:28:51.389 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:28:51.389 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:51.389 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:51.389 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37242 2026-02-17T08:28:51.390 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:28:51.390 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:28:51.390 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:29: run: for func in $funcs 2026-02-17T08:28:51.390 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:30: run: TEST_balancer2 td/balancer 2026-02-17T08:28:51.391 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:122: TEST_balancer2: local dir=td/balancer 2026-02-17T08:28:51.391 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:123: TEST_balancer2: TEST_PGS1=118 2026-02-17T08:28:51.391 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:124: TEST_balancer2: TEST_PGS2=132 2026-02-17T08:28:51.391 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:125: TEST_balancer2: expr 118 + 132 2026-02-17T08:28:51.392 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:125: TEST_balancer2: TOTAL_PGS=250 2026-02-17T08:28:51.392 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:126: TEST_balancer2: OSDS=5 2026-02-17T08:28:51.392 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:127: TEST_balancer2: DEFAULT_REPLICAS=3 2026-02-17T08:28:51.392 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:129: TEST_balancer2: expr '(' 118 '*' 3 ')' / 5 2026-02-17T08:28:51.392 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:129: TEST_balancer2: FINAL_PER_OSD1=70 2026-02-17T08:28:51.392 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:131: TEST_balancer2: expr '(' '(' 118 + 132 ')' '*' 3 ')' / 5 2026-02-17T08:28:51.394 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:131: TEST_balancer2: FINAL_PER_OSD2=150 2026-02-17T08:28:51.394 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:133: TEST_balancer2: CEPH_ARGS+='--osd_pool_default_pg_autoscale_mode=off ' 2026-02-17T08:28:51.394 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:134: TEST_balancer2: CEPH_ARGS+='--debug_osd=20 ' 2026-02-17T08:28:51.394 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:135: TEST_balancer2: setup td/balancer 2026-02-17T08:28:51.394 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/balancer 2026-02-17T08:28:51.395 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/balancer 2026-02-17T08:28:51.395 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/balancer 2026-02-17T08:28:51.395 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:28:51.395 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/balancer KILL 2026-02-17T08:28:51.395 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:28:51.395 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:28:51.395 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:28:51.395 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:28:51.395 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:28:51.396 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:28:51.396 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:28:51.396 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:28:51.397 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:28:51.397 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:28:51.398 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:28:51.398 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:28:51.398 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:28:51.398 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:28:51.399 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:28:51.399 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:28:51.399 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:28:51.401 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:28:51.401 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/balancer 2026-02-17T08:28:51.402 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:28:51.403 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:51.403 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:51.403 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37242 2026-02-17T08:28:51.403 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:28:51.403 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:28:51.403 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/balancer 2026-02-17T08:28:51.404 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:28:51.404 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:51.404 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:51.405 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.37242 2026-02-17T08:28:51.406 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:28:51.406 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:28:51.406 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:28:51.406 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/balancer 1' TERM HUP INT 2026-02-17T08:28:51.406 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:136: TEST_balancer2: run_mon td/balancer a 2026-02-17T08:28:51.406 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/balancer 2026-02-17T08:28:51.406 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:28:51.406 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:28:51.407 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:28:51.407 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/balancer/a 2026-02-17T08:28:51.407 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/balancer/a --run-dir=td/balancer 2026-02-17T08:28:51.425 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:28:51.425 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:51.425 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:51.426 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:51.426 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:51.426 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:51.426 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:51.426 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/balancer/a '--log-file=td/balancer/$name.log' '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --mon-cluster-log-file=td/balancer/log --run-dir=td/balancer '--pid-file=td/balancer/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:28:51.451 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:28:51.452 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:28:51.452 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:28:51.452 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:28:51.452 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:28:51.453 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:28:51.453 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:28:51.453 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:28:51.453 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:28:51.454 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:28:51.454 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:51.454 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:51.454 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37242/ceph-mon.a.asok 2026-02-17T08:28:51.454 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:28:51.454 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37242/ceph-mon.a.asok config get fsid 2026-02-17T08:28:51.498 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:28:51.498 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:28:51.498 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:28:51.498 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:28:51.498 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:28:51.500 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:28:51.500 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:28:51.500 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:28:51.500 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:28:51.500 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:51.500 INFO:tasks.workunit.client.0.trial072.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:51.500 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.37242/ceph-mon.a.asok 2026-02-17T08:28:51.500 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:28:51.500 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.37242/ceph-mon.a.asok config get mon_host 2026-02-17T08:28:51.545 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:137: TEST_balancer2: run_mgr td/balancer x 2026-02-17T08:28:51.545 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/balancer 2026-02-17T08:28:51.545 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:28:51.545 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:28:51.545 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:28:51.545 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/balancer/x 2026-02-17T08:28:51.545 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:28:51.642 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:28:51.642 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:51.642 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:51.642 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:51.643 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:51.643 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:51.643 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:51.643 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:28:51.643 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/balancer/x '--log-file=td/balancer/$name.log' '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --run-dir=td/balancer '--pid-file=td/balancer/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:28:51.660 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:138: TEST_balancer2: expr 5 - 1 2026-02-17T08:28:51.661 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:138: TEST_balancer2: seq 0 4 2026-02-17T08:28:51.664 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:138: TEST_balancer2: for i in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:140: TEST_balancer2: run_osd td/balancer 0 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/balancer 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/balancer/0 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 ' 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/balancer/0' 2026-02-17T08:28:51.665 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/balancer/0/journal' 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/balancer' 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:51.666 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/balancer/$name.log' 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/balancer/$name.pid' 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/balancer/0 2026-02-17T08:28:51.667 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:28:51.668 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e73e59b0-03c8-4dee-b45e-5775087b99cf 2026-02-17T08:28:51.668 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 e73e59b0-03c8-4dee-b45e-5775087b99cf' 2026-02-17T08:28:51.668 INFO:tasks.workunit.client.0.trial072.stdout:add osd0 e73e59b0-03c8-4dee-b45e-5775087b99cf 2026-02-17T08:28:51.669 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:28:51.677 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDDJpRpaxVDKBAA8pYYLl9MsXX2XpvidS7DuQ== 2026-02-17T08:28:51.677 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDDJpRpaxVDKBAA8pYYLl9MsXX2XpvidS7DuQ=="}' 2026-02-17T08:28:51.677 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e73e59b0-03c8-4dee-b45e-5775087b99cf -i td/balancer/0/new.json 2026-02-17T08:28:51.777 INFO:tasks.workunit.client.0.trial072.stdout:0 2026-02-17T08:28:51.783 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/balancer/0/new.json 2026-02-17T08:28:51.785 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/0 --osd-journal=td/balancer/0/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDDJpRpaxVDKBAA8pYYLl9MsXX2XpvidS7DuQ== --osd-uuid e73e59b0-03c8-4dee-b45e-5775087b99cf 2026-02-17T08:28:51.804 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:51.802+0000 7f584721b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:51.805 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:51.804+0000 7f584721b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:51.806 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:51.805+0000 7f584721b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:51.807 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:51.805+0000 7f584721b780 -1 bdev(0x560bfc475c00 td/balancer/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:28:51.807 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:51.805+0000 7f584721b780 -1 bluestore(td/balancer/0) _read_fsid unparsable uuid 2026-02-17T08:28:54.197 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/balancer/0/keyring 2026-02-17T08:28:54.197 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:28:54.197 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:28:54.198 INFO:tasks.workunit.client.0.trial072.stdout:adding osd0 key to auth repository 2026-02-17T08:28:54.198 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/balancer/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:28:54.455 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:28:54.455 INFO:tasks.workunit.client.0.trial072.stdout:start osd.0 2026-02-17T08:28:54.456 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/0 --osd-journal=td/balancer/0/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:28:54.456 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:28:54.456 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:28:54.456 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:28:54.472 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:54.471+0000 7f320742e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:54.474 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:54.473+0000 7f320742e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:54.475 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:54.474+0000 7f320742e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:54.642 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:28:54.643 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:28:54.643 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:28:54.643 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:28:54.643 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:28:54.643 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:54.643 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:28:54.643 INFO:tasks.workunit.client.0.trial072.stdout:0 2026-02-17T08:28:54.644 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:54.644 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:54.830 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:55.809 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:55.807+0000 7f320742e780 -1 Falling back to public interface 2026-02-17T08:28:55.831 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:55.831 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:55.831 INFO:tasks.workunit.client.0.trial072.stdout:1 2026-02-17T08:28:55.832 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:28:55.832 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:55.832 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:56.020 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:57.022 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:57.022 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:57.022 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:28:57.023 INFO:tasks.workunit.client.0.trial072.stdout:2 2026-02-17T08:28:57.023 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:57.023 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:57.210 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:58.211 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:58.211 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:58.212 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:28:58.212 INFO:tasks.workunit.client.0.trial072.stdout:3 2026-02-17T08:28:58.212 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:58.212 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:58.400 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:58.502 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:58.501+0000 7f320742e780 -1 osd.0 0 log_to_monitors true 2026-02-17T08:28:59.402 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:59.402 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:59.402 INFO:tasks.workunit.client.0.trial072.stdout:4 2026-02-17T08:28:59.403 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:28:59.403 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:59.403 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:59.590 INFO:tasks.workunit.client.0.trial072.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3685853595,v1:127.0.0.1:6803/3685853595] [v2:127.0.0.1:6804/3685853595,v1:127.0.0.1:6805/3685853595] exists,up e73e59b0-03c8-4dee-b45e-5775087b99cf 2026-02-17T08:28:59.595 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:28:59.595 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:28:59.595 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:28:59.595 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:138: TEST_balancer2: for i in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T08:28:59.595 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:140: TEST_balancer2: run_osd td/balancer 1 2026-02-17T08:28:59.595 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/balancer 2026-02-17T08:28:59.595 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:28:59.595 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:28:59.595 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:28:59.595 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/balancer/1 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 ' 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/balancer/1' 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/balancer/1/journal' 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/balancer' 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:59.596 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/balancer/$name.log' 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/balancer/$name.pid' 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:28:59.597 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:28:59.598 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:28:59.598 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:28:59.598 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:28:59.598 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:28:59.598 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/balancer/1 2026-02-17T08:28:59.598 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:28:59.598 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=f67faea8-7f42-4bab-b6f1-41aefa8bcf42 2026-02-17T08:28:59.598 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 f67faea8-7f42-4bab-b6f1-41aefa8bcf42' 2026-02-17T08:28:59.598 INFO:tasks.workunit.client.0.trial072.stdout:add osd1 f67faea8-7f42-4bab-b6f1-41aefa8bcf42 2026-02-17T08:28:59.599 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:28:59.605 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDLJpRpN1oAJBAAnIziub+I0HMcDonbfIgZPA== 2026-02-17T08:28:59.605 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDLJpRpN1oAJBAAnIziub+I0HMcDonbfIgZPA=="}' 2026-02-17T08:28:59.605 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new f67faea8-7f42-4bab-b6f1-41aefa8bcf42 -i td/balancer/1/new.json 2026-02-17T08:28:59.797 INFO:tasks.workunit.client.0.trial072.stdout:1 2026-02-17T08:28:59.804 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/balancer/1/new.json 2026-02-17T08:28:59.805 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/1 --osd-journal=td/balancer/1/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDLJpRpN1oAJBAAnIziub+I0HMcDonbfIgZPA== --osd-uuid f67faea8-7f42-4bab-b6f1-41aefa8bcf42 2026-02-17T08:28:59.823 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:59.822+0000 7fba4f7ad780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:59.824 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:59.823+0000 7fba4f7ad780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:59.825 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:59.824+0000 7fba4f7ad780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:59.825 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:59.824+0000 7fba4f7ad780 -1 bdev(0x55f4afa95c00 td/balancer/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:28:59.826 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:28:59.824+0000 7fba4f7ad780 -1 bluestore(td/balancer/1) _read_fsid unparsable uuid 2026-02-17T08:29:02.197 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/balancer/1/keyring 2026-02-17T08:29:02.197 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:29:02.197 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:29:02.198 INFO:tasks.workunit.client.0.trial072.stdout:adding osd1 key to auth repository 2026-02-17T08:29:02.198 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/balancer/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:29:02.456 INFO:tasks.workunit.client.0.trial072.stdout:start osd.1 2026-02-17T08:29:02.457 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:29:02.457 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/1 --osd-journal=td/balancer/1/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:29:02.458 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:29:02.458 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:29:02.458 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:29:02.473 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:02.472+0000 7fa726353780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:02.474 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:02.473+0000 7fa726353780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:02.475 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:02.474+0000 7fa726353780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:02.653 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:29:02.653 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:29:02.653 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:29:02.653 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:29:02.653 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:29:02.654 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:02.654 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:29:02.654 INFO:tasks.workunit.client.0.trial072.stdout:0 2026-02-17T08:29:02.654 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:02.655 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:29:02.839 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:03.810 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:03.809+0000 7fa726353780 -1 Falling back to public interface 2026-02-17T08:29:03.840 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:03.840 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:03.840 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:29:03.841 INFO:tasks.workunit.client.0.trial072.stdout:1 2026-02-17T08:29:03.841 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:03.841 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:29:04.028 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:05.029 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:05.029 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:05.029 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:29:05.030 INFO:tasks.workunit.client.0.trial072.stdout:2 2026-02-17T08:29:05.030 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:05.030 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:29:05.217 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:06.219 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:06.219 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:06.219 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:29:06.219 INFO:tasks.workunit.client.0.trial072.stdout:3 2026-02-17T08:29:06.220 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:06.220 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:29:06.412 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:06.513 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:06.511+0000 7fa726353780 -1 osd.1 0 log_to_monitors true 2026-02-17T08:29:07.413 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:07.413 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:07.414 INFO:tasks.workunit.client.0.trial072.stdout:4 2026-02-17T08:29:07.414 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:29:07.415 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:07.415 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:29:07.601 INFO:tasks.workunit.client.0.trial072.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3956499263,v1:127.0.0.1:6811/3956499263] [v2:127.0.0.1:6812/3956499263,v1:127.0.0.1:6813/3956499263] exists,up f67faea8-7f42-4bab-b6f1-41aefa8bcf42 2026-02-17T08:29:07.605 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:29:07.605 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:29:07.605 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:29:07.605 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:138: TEST_balancer2: for i in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:140: TEST_balancer2: run_osd td/balancer 2 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/balancer 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/balancer/2 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 ' 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/balancer/2' 2026-02-17T08:29:07.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/balancer/2/journal' 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/balancer' 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:29:07.607 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/balancer/$name.log' 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/balancer/$name.pid' 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/balancer/2 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:29:07.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=368d0c9b-316b-4291-a8d1-3f4019855773 2026-02-17T08:29:07.609 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 368d0c9b-316b-4291-a8d1-3f4019855773' 2026-02-17T08:29:07.609 INFO:tasks.workunit.client.0.trial072.stdout:add osd2 368d0c9b-316b-4291-a8d1-3f4019855773 2026-02-17T08:29:07.609 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:29:07.617 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDTJpRpzcKwJBAAs5bp2bqDIyIzPYW04bg3UQ== 2026-02-17T08:29:07.617 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDTJpRpzcKwJBAAs5bp2bqDIyIzPYW04bg3UQ=="}' 2026-02-17T08:29:07.617 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 368d0c9b-316b-4291-a8d1-3f4019855773 -i td/balancer/2/new.json 2026-02-17T08:29:07.810 INFO:tasks.workunit.client.0.trial072.stdout:2 2026-02-17T08:29:07.817 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/balancer/2/new.json 2026-02-17T08:29:07.818 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/2 --osd-journal=td/balancer/2/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDTJpRpzcKwJBAAs5bp2bqDIyIzPYW04bg3UQ== --osd-uuid 368d0c9b-316b-4291-a8d1-3f4019855773 2026-02-17T08:29:07.837 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:07.834+0000 7f7958991780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:07.838 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:07.836+0000 7f7958991780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:07.839 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:07.837+0000 7f7958991780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:07.839 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:07.837+0000 7f7958991780 -1 bdev(0x55eef3aadc00 td/balancer/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:29:07.840 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:07.837+0000 7f7958991780 -1 bluestore(td/balancer/2) _read_fsid unparsable uuid 2026-02-17T08:29:09.962 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/balancer/2/keyring 2026-02-17T08:29:09.963 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:29:09.963 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:29:09.964 INFO:tasks.workunit.client.0.trial072.stdout:adding osd2 key to auth repository 2026-02-17T08:29:09.964 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/balancer/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:29:10.218 INFO:tasks.workunit.client.0.trial072.stdout:start osd.2 2026-02-17T08:29:10.219 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:29:10.219 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/2 --osd-journal=td/balancer/2/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:29:10.219 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:29:10.219 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:29:10.219 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:29:10.235 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:10.232+0000 7f7d7862a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:10.236 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:10.234+0000 7f7d7862a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:10.237 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:10.235+0000 7f7d7862a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:10.409 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:29:10.409 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:29:10.409 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:29:10.409 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:29:10.409 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:29:10.409 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:10.409 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:29:10.409 INFO:tasks.workunit.client.0.trial072.stdout:0 2026-02-17T08:29:10.410 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:10.410 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:10.598 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:11.599 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:11.599 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:11.599 INFO:tasks.workunit.client.0.trial072.stdout:1 2026-02-17T08:29:11.600 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:29:11.600 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:11.600 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:11.793 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:11.818 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:11.815+0000 7f7d7862a780 -1 Falling back to public interface 2026-02-17T08:29:12.794 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:12.795 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:12.795 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:29:12.795 INFO:tasks.workunit.client.0.trial072.stdout:2 2026-02-17T08:29:12.796 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:12.796 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:12.987 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:13.988 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:13.988 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:13.989 INFO:tasks.workunit.client.0.trial072.stdout:3 2026-02-17T08:29:13.989 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:29:13.989 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:13.989 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:14.177 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:14.777 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:14.775+0000 7f7d7862a780 -1 osd.2 0 log_to_monitors true 2026-02-17T08:29:15.178 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:15.178 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:15.179 INFO:tasks.workunit.client.0.trial072.stdout:4 2026-02-17T08:29:15.179 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:29:15.180 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:15.180 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:15.370 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:16.371 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:16.372 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:16.372 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:29:16.372 INFO:tasks.workunit.client.0.trial072.stdout:5 2026-02-17T08:29:16.373 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:16.373 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:16.560 INFO:tasks.workunit.client.0.trial072.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3362922430,v1:127.0.0.1:6819/3362922430] [v2:127.0.0.1:6820/3362922430,v1:127.0.0.1:6821/3362922430] exists,up 368d0c9b-316b-4291-a8d1-3f4019855773 2026-02-17T08:29:16.564 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:29:16.564 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:29:16.565 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:29:16.565 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:138: TEST_balancer2: for i in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T08:29:16.565 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:140: TEST_balancer2: run_osd td/balancer 3 2026-02-17T08:29:16.565 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/balancer 2026-02-17T08:29:16.565 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:29:16.565 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:29:16.565 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:29:16.565 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/balancer/3 2026-02-17T08:29:16.565 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 ' 2026-02-17T08:29:16.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:29:16.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:29:16.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:29:16.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/balancer/3' 2026-02-17T08:29:16.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/balancer/3/journal' 2026-02-17T08:29:16.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:29:16.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:29:16.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/balancer' 2026-02-17T08:29:16.566 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:29:16.566 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:29:16.566 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:29:16.567 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:29:16.567 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:16.567 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:29:16.567 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:29:16.567 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:29:16.567 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:29:16.567 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:29:16.567 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:29:16.567 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/balancer/$name.log' 2026-02-17T08:29:16.567 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/balancer/$name.pid' 2026-02-17T08:29:16.567 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:29:16.568 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:29:16.568 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:29:16.568 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:29:16.568 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:29:16.568 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:29:16.568 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/balancer/3 2026-02-17T08:29:16.568 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:29:16.568 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c936f484-c583-4cc5-9f16-e0ba8c4647ad 2026-02-17T08:29:16.568 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 c936f484-c583-4cc5-9f16-e0ba8c4647ad' 2026-02-17T08:29:16.569 INFO:tasks.workunit.client.0.trial072.stdout:add osd3 c936f484-c583-4cc5-9f16-e0ba8c4647ad 2026-02-17T08:29:16.569 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:29:16.575 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDcJpRpXb05IhAATNSM1OdPw2OlGfUkmhug3w== 2026-02-17T08:29:16.576 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDcJpRpXb05IhAATNSM1OdPw2OlGfUkmhug3w=="}' 2026-02-17T08:29:16.576 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c936f484-c583-4cc5-9f16-e0ba8c4647ad -i td/balancer/3/new.json 2026-02-17T08:29:16.774 INFO:tasks.workunit.client.0.trial072.stdout:3 2026-02-17T08:29:16.780 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/balancer/3/new.json 2026-02-17T08:29:16.781 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/3 --osd-journal=td/balancer/3/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDcJpRpXb05IhAATNSM1OdPw2OlGfUkmhug3w== --osd-uuid c936f484-c583-4cc5-9f16-e0ba8c4647ad 2026-02-17T08:29:16.799 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:16.797+0000 7f0f3a7d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:16.800 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:16.798+0000 7f0f3a7d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:16.801 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:16.799+0000 7f0f3a7d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:16.802 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:16.799+0000 7f0f3a7d4780 -1 bdev(0x55d75513dc00 td/balancer/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:29:16.802 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:16.799+0000 7f0f3a7d4780 -1 bluestore(td/balancer/3) _read_fsid unparsable uuid 2026-02-17T08:29:18.924 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/balancer/3/keyring 2026-02-17T08:29:18.924 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:29:18.925 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:29:18.925 INFO:tasks.workunit.client.0.trial072.stdout:adding osd3 key to auth repository 2026-02-17T08:29:18.925 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/balancer/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:29:19.183 INFO:tasks.workunit.client.0.trial072.stdout:start osd.3 2026-02-17T08:29:19.183 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:29:19.184 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/3 --osd-journal=td/balancer/3/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:29:19.184 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:29:19.184 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:29:19.184 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:29:19.200 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:19.198+0000 7f5fb4ac6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:19.201 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:19.199+0000 7f5fb4ac6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:19.202 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:19.200+0000 7f5fb4ac6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:19.373 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:29:19.374 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:29:19.374 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:29:19.374 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:29:19.374 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:29:19.374 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:19.374 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:29:19.374 INFO:tasks.workunit.client.0.trial072.stdout:0 2026-02-17T08:29:19.375 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:19.375 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:29:19.564 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:20.541 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:20.539+0000 7f5fb4ac6780 -1 Falling back to public interface 2026-02-17T08:29:20.565 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:20.565 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:20.565 INFO:tasks.workunit.client.0.trial072.stdout:1 2026-02-17T08:29:20.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:29:20.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:20.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:29:20.751 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:21.752 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:21.752 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:21.753 INFO:tasks.workunit.client.0.trial072.stdout:2 2026-02-17T08:29:21.753 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:29:21.753 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:21.753 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:29:21.942 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:22.943 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:22.943 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:22.943 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:29:22.944 INFO:tasks.workunit.client.0.trial072.stdout:3 2026-02-17T08:29:22.944 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:22.944 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:29:23.131 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:23.282 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:23.279+0000 7f5fb4ac6780 -1 osd.3 0 log_to_monitors true 2026-02-17T08:29:24.132 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:24.132 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:24.132 INFO:tasks.workunit.client.0.trial072.stdout:4 2026-02-17T08:29:24.133 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:29:24.133 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:24.133 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:29:24.321 INFO:tasks.workunit.client.0.trial072.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2137098745,v1:127.0.0.1:6827/2137098745] [v2:127.0.0.1:6828/2137098745,v1:127.0.0.1:6829/2137098745] exists,up c936f484-c583-4cc5-9f16-e0ba8c4647ad 2026-02-17T08:29:24.325 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:29:24.325 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:29:24.325 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:29:24.325 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:138: TEST_balancer2: for i in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T08:29:24.325 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:140: TEST_balancer2: run_osd td/balancer 4 2026-02-17T08:29:24.325 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/balancer 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/balancer/4 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 ' 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/balancer/4' 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/balancer/4/journal' 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:29:24.326 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/balancer' 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:29:24.327 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/balancer/$name.log' 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/balancer/$name.pid' 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/balancer/4 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7c73a5fa-9402-42ea-9260-69e3618f1dc0 2026-02-17T08:29:24.328 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 7c73a5fa-9402-42ea-9260-69e3618f1dc0' 2026-02-17T08:29:24.329 INFO:tasks.workunit.client.0.trial072.stdout:add osd4 7c73a5fa-9402-42ea-9260-69e3618f1dc0 2026-02-17T08:29:24.329 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:29:24.337 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDkJpRpPRv/ExAAP76381WQm/EjO5pLZhxV7A== 2026-02-17T08:29:24.337 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDkJpRpPRv/ExAAP76381WQm/EjO5pLZhxV7A=="}' 2026-02-17T08:29:24.337 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7c73a5fa-9402-42ea-9260-69e3618f1dc0 -i td/balancer/4/new.json 2026-02-17T08:29:24.528 INFO:tasks.workunit.client.0.trial072.stdout:4 2026-02-17T08:29:24.535 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/balancer/4/new.json 2026-02-17T08:29:24.536 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/4 --osd-journal=td/balancer/4/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDkJpRpPRv/ExAAP76381WQm/EjO5pLZhxV7A== --osd-uuid 7c73a5fa-9402-42ea-9260-69e3618f1dc0 2026-02-17T08:29:24.554 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:24.552+0000 7f17a4032780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:24.555 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:24.553+0000 7f17a4032780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:24.556 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:24.554+0000 7f17a4032780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:24.557 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:24.555+0000 7f17a4032780 -1 bdev(0x555aeb27dc00 td/balancer/4/block) open stat got: (1) Operation not permitted 2026-02-17T08:29:24.557 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:24.555+0000 7f17a4032780 -1 bluestore(td/balancer/4) _read_fsid unparsable uuid 2026-02-17T08:29:26.679 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/balancer/4/keyring 2026-02-17T08:29:26.679 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:29:26.680 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2026-02-17T08:29:26.680 INFO:tasks.workunit.client.0.trial072.stdout:adding osd4 key to auth repository 2026-02-17T08:29:26.681 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/balancer/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:29:26.937 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2026-02-17T08:29:26.938 INFO:tasks.workunit.client.0.trial072.stdout:start osd.4 2026-02-17T08:29:26.939 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=f7bad7fa-3e1a-4cad-a830-859bcc106914 --auth-supported=none --mon-host=127.0.0.1:7102 --osd_pool_default_pg_autoscale_mode=off --debug_osd=20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/balancer/4 --osd-journal=td/balancer/4/journal --chdir= --run-dir=td/balancer '--admin-socket=/tmp/ceph-asok.37242/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/balancer/$name.log' '--pid-file=td/balancer/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:29:26.939 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:29:26.939 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:29:26.939 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:29:26.957 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:26.955+0000 7fc145c2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:26.959 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:26.957+0000 7fc145c2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:26.960 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:26.957+0000 7fc145c2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:27.125 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2026-02-17T08:29:27.126 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:29:27.126 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2026-02-17T08:29:27.126 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:29:27.126 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:29:27.126 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:27.127 INFO:tasks.workunit.client.0.trial072.stdout:0 2026-02-17T08:29:27.127 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:29:27.127 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:27.127 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:29:27.310 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:28.311 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:28.311 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:28.311 INFO:tasks.workunit.client.0.trial072.stdout:1 2026-02-17T08:29:28.312 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:29:28.312 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:28.312 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:29:28.501 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:28.556 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:28.553+0000 7fc145c2d780 -1 Falling back to public interface 2026-02-17T08:29:29.502 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:29.502 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:29.502 INFO:tasks.workunit.client.0.trial072.stdout:2 2026-02-17T08:29:29.503 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:29:29.503 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:29.503 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:29:29.694 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:30.695 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:30.695 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:30.695 INFO:tasks.workunit.client.0.trial072.stdout:3 2026-02-17T08:29:30.696 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:29:30.696 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:30.696 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:29:30.883 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:31.260 INFO:tasks.workunit.client.0.trial072.stderr:2026-02-17T08:29:31.259+0000 7fc145c2d780 -1 osd.4 0 log_to_monitors true 2026-02-17T08:29:31.884 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:31.884 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:31.885 INFO:tasks.workunit.client.0.trial072.stdout:4 2026-02-17T08:29:31.885 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:29:31.886 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:31.886 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:29:32.072 INFO:tasks.workunit.client.0.trial072.stdout:osd.4 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/159241780,v1:127.0.0.1:6835/159241780] [v2:127.0.0.1:6836/159241780,v1:127.0.0.1:6837/159241780] exists,up 7c73a5fa-9402-42ea-9260-69e3618f1dc0 2026-02-17T08:29:32.073 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:29:32.073 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:29:32.073 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:29:32.074 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:143: TEST_balancer2: ceph osd set-require-min-compat-client luminous 2026-02-17T08:29:32.366 INFO:tasks.workunit.client.0.trial072.stderr:set require_min_compat_client to luminous 2026-02-17T08:29:32.373 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:144: TEST_balancer2: ceph config set mgr mgr/balancer/upmap_max_deviation 1 2026-02-17T08:29:32.566 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:145: TEST_balancer2: ceph balancer mode upmap 2026-02-17T08:29:32.759 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:146: TEST_balancer2: ceph balancer on 2026-02-17T08:29:32.946 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:147: TEST_balancer2: ceph config set mgr mgr/balancer/sleep_interval 5 2026-02-17T08:29:33.137 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:149: TEST_balancer2: create_pool test1 118 2026-02-17T08:29:33.137 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test1 118 2026-02-17T08:29:33.337 INFO:tasks.workunit.client.0.trial072.stderr:pool 'test1' already exists 2026-02-17T08:29:33.344 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:29:34.346 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:151: TEST_balancer2: wait_for_clean 2026-02-17T08:29:34.346 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:29:34.346 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:29:34.347 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:29:34.347 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:29:34.348 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:29:34.348 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:29:34.348 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:29:34.348 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:29:34.348 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:29:34.432 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:29:34.432 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:29:34.432 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:29:34.432 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:29:34.433 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:29:34.433 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:29:34.623 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:29:34.623 INFO:tasks.workunit.client.0.trial072.stderr:1 2026-02-17T08:29:34.623 INFO:tasks.workunit.client.0.trial072.stderr:2 2026-02-17T08:29:34.624 INFO:tasks.workunit.client.0.trial072.stderr:3 2026-02-17T08:29:34.624 INFO:tasks.workunit.client.0.trial072.stderr:4' 2026-02-17T08:29:34.624 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:29:34.624 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:34.624 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:29:34.687 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836490 2026-02-17T08:29:34.687 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836490 2026-02-17T08:29:34.687 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T08:29:34.687 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:34.687 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:29:34.749 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705672 2026-02-17T08:29:34.750 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705672 2026-02-17T08:29:34.750 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490 1-38654705672' 2026-02-17T08:29:34.750 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:34.750 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:29:34.811 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574855 2026-02-17T08:29:34.811 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574855 2026-02-17T08:29:34.811 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490 1-38654705672 2-55834574855' 2026-02-17T08:29:34.811 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:34.811 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:29:34.875 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411333 2026-02-17T08:29:34.875 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411333 2026-02-17T08:29:34.875 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490 1-38654705672 2-55834574855 3-77309411333' 2026-02-17T08:29:34.875 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:34.875 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:29:34.937 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=98784247811 2026-02-17T08:29:34.937 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 98784247811 2026-02-17T08:29:34.938 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490 1-38654705672 2-55834574855 3-77309411333 4-98784247811' 2026-02-17T08:29:34.938 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:34.938 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836490 2026-02-17T08:29:34.938 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:34.938 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:29:34.939 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836490 2026-02-17T08:29:34.939 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:34.940 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836490 2026-02-17T08:29:34.940 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T08:29:34.940 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.0 seq 21474836490 2026-02-17T08:29:34.941 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:29:35.127 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836490 2026-02-17T08:29:35.127 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:29:36.128 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:29:36.128 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:29:36.316 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-17T08:29:36.316 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:36.317 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705672 2026-02-17T08:29:36.317 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:36.317 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:29:36.318 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705672 2026-02-17T08:29:36.318 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:36.319 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705672 2026-02-17T08:29:36.319 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-17T08:29:36.319 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.1 seq 38654705672 2026-02-17T08:29:36.320 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:29:36.507 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-17T08:29:36.507 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:36.508 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574855 2026-02-17T08:29:36.508 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:36.509 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:29:36.509 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574855 2026-02-17T08:29:36.509 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:36.510 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574855 2026-02-17T08:29:36.511 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574855' 2026-02-17T08:29:36.511 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.2 seq 55834574855 2026-02-17T08:29:36.511 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:29:36.698 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574855 -lt 55834574855 2026-02-17T08:29:36.698 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:36.698 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-77309411333 2026-02-17T08:29:36.699 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:36.699 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:29:36.700 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-77309411333 2026-02-17T08:29:36.700 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:36.701 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411333 2026-02-17T08:29:36.701 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 77309411333' 2026-02-17T08:29:36.701 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.3 seq 77309411333 2026-02-17T08:29:36.702 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:29:36.888 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411333 -lt 77309411333 2026-02-17T08:29:36.888 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:36.889 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-98784247811 2026-02-17T08:29:36.889 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:36.889 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:29:36.890 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-98784247811 2026-02-17T08:29:36.890 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:36.891 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=98784247811 2026-02-17T08:29:36.891 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 98784247811' 2026-02-17T08:29:36.892 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.4 seq 98784247811 2026-02-17T08:29:36.892 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:29:37.081 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 98784247811 -lt 98784247811 2026-02-17T08:29:37.082 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:29:37.082 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:29:37.082 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:29:37.335 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 118 == 0 2026-02-17T08:29:37.335 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:29:37.335 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:29:37.335 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:29:37.335 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:29:37.335 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:29:37.335 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:29:37.335 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:29:37.533 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=118 2026-02-17T08:29:37.533 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:29:37.533 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:29:37.534 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:29:37.786 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 118 = 118 2026-02-17T08:29:37.786 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:29:37.786 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:29:37.786 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:154: TEST_balancer2: OK=no 2026-02-17T08:29:37.786 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: seq 1 25 2026-02-17T08:29:37.787 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:29:37.787 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:29:42.787 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:29:42.790 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:29:42.791 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:29:47.792 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:29:47.794 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:29:47.795 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:29:52.796 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:29:52.799 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:29:52.799 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:29:57.800 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:29:57.803 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:29:57.804 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:30:02.805 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:30:02.808 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:30:02.808 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:30:07.809 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:30:07.812 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:30:07.812 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:30:12.813 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:30:12.816 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:30:12.816 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:30:17.818 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:30:17.821 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:30:17.821 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:30:22.822 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:30:22.826 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:30:22.826 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:30:27.827 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:30:27.830 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:30:27.830 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:30:32.832 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:30:32.835 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:155: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:30:32.835 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:157: TEST_balancer2: sleep 5 2026-02-17T08:30:37.836 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:158: TEST_balancer2: grep -q 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:30:37.840 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:160: TEST_balancer2: OK=yes 2026-02-17T08:30:37.840 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:161: TEST_balancer2: break 2026-02-17T08:30:37.840 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:164: TEST_balancer2: test yes = yes 2026-02-17T08:30:37.840 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:166: TEST_balancer2: sleep 10 2026-02-17T08:30:47.842 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:167: TEST_balancer2: wait_for_clean 2026-02-17T08:30:47.842 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:30:47.843 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:30:47.843 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:30:47.843 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:30:47.844 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:30:47.844 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:30:47.844 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:30:47.845 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:30:47.845 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:30:47.929 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:30:47.929 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:30:47.930 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:30:47.930 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:30:47.930 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:30:47.930 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:30:48.117 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:30:48.117 INFO:tasks.workunit.client.0.trial072.stderr:1 2026-02-17T08:30:48.117 INFO:tasks.workunit.client.0.trial072.stderr:2 2026-02-17T08:30:48.117 INFO:tasks.workunit.client.0.trial072.stderr:3 2026-02-17T08:30:48.118 INFO:tasks.workunit.client.0.trial072.stderr:4' 2026-02-17T08:30:48.118 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:30:48.118 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:48.118 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:30:48.181 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836506 2026-02-17T08:30:48.181 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836506 2026-02-17T08:30:48.181 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836506' 2026-02-17T08:30:48.182 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:48.182 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:30:48.243 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705689 2026-02-17T08:30:48.243 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705689 2026-02-17T08:30:48.243 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836506 1-38654705689' 2026-02-17T08:30:48.243 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:48.244 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:30:48.307 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574872 2026-02-17T08:30:48.307 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574872 2026-02-17T08:30:48.307 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836506 1-38654705689 2-55834574872' 2026-02-17T08:30:48.307 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:48.307 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:30:48.371 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411349 2026-02-17T08:30:48.371 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411349 2026-02-17T08:30:48.371 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836506 1-38654705689 2-55834574872 3-77309411349' 2026-02-17T08:30:48.371 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:48.372 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:30:48.435 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=98784247828 2026-02-17T08:30:48.435 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 98784247828 2026-02-17T08:30:48.436 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836506 1-38654705689 2-55834574872 3-77309411349 4-98784247828' 2026-02-17T08:30:48.436 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:48.436 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836506 2026-02-17T08:30:48.436 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:48.437 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:30:48.437 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836506 2026-02-17T08:30:48.437 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:48.438 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836506 2026-02-17T08:30:48.438 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2026-02-17T08:30:48.438 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.0 seq 21474836506 2026-02-17T08:30:48.439 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:30:48.626 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836504 -lt 21474836506 2026-02-17T08:30:48.627 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:30:49.628 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:30:49.628 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:30:49.824 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836506 -lt 21474836506 2026-02-17T08:30:49.825 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:49.825 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705689 2026-02-17T08:30:49.825 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:49.826 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:30:49.826 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705689 2026-02-17T08:30:49.826 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:49.828 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705689 2026-02-17T08:30:49.828 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705689' 2026-02-17T08:30:49.828 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.1 seq 38654705689 2026-02-17T08:30:49.828 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:30:50.016 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705689 -lt 38654705689 2026-02-17T08:30:50.016 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:50.016 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574872 2026-02-17T08:30:50.016 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:50.017 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:30:50.018 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574872 2026-02-17T08:30:50.018 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:50.019 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574872 2026-02-17T08:30:50.019 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574872' 2026-02-17T08:30:50.019 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.2 seq 55834574872 2026-02-17T08:30:50.019 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:30:50.207 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574872 -lt 55834574872 2026-02-17T08:30:50.208 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:50.208 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-77309411349 2026-02-17T08:30:50.208 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:50.208 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:30:50.209 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-77309411349 2026-02-17T08:30:50.209 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:50.210 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411349 2026-02-17T08:30:50.210 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 77309411349' 2026-02-17T08:30:50.210 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.3 seq 77309411349 2026-02-17T08:30:50.211 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:30:50.399 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411350 -lt 77309411349 2026-02-17T08:30:50.399 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:50.399 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-98784247828 2026-02-17T08:30:50.399 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:50.400 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:30:50.400 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-98784247828 2026-02-17T08:30:50.401 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:50.401 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=98784247828 2026-02-17T08:30:50.402 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 98784247828' 2026-02-17T08:30:50.402 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.4 seq 98784247828 2026-02-17T08:30:50.402 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:30:50.587 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 98784247828 -lt 98784247828 2026-02-17T08:30:50.588 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:30:50.588 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:30:50.589 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:30:50.850 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 118 == 0 2026-02-17T08:30:50.850 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:30:50.850 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:30:50.850 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:30:50.850 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:30:50.850 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:30:50.851 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:30:50.851 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:30:51.045 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=118 2026-02-17T08:30:51.045 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:30:51.045 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:30:51.045 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:30:51.295 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 118 = 118 2026-02-17T08:30:51.296 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:30:51.296 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:30:51.296 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:168: TEST_balancer2: ceph osd df 2026-02-17T08:30:51.473 INFO:tasks.workunit.client.0.trial072.stdout:ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS 2026-02-17T08:30:51.474 INFO:tasks.workunit.client.0.trial072.stdout: 0 ssd 0.09769 1.00000 100 GiB 27 MiB 248 KiB 1 KiB 26 MiB 100 GiB 0.03 1.00 71 up 2026-02-17T08:30:51.474 INFO:tasks.workunit.client.0.trial072.stdout: 1 ssd 0.09769 1.00000 100 GiB 27 MiB 248 KiB 1 KiB 26 MiB 100 GiB 0.03 1.00 71 up 2026-02-17T08:30:51.474 INFO:tasks.workunit.client.0.trial072.stdout: 2 ssd 0.09769 1.00000 100 GiB 27 MiB 248 KiB 1 KiB 26 MiB 100 GiB 0.03 1.00 70 up 2026-02-17T08:30:51.474 INFO:tasks.workunit.client.0.trial072.stdout: 3 ssd 0.09769 1.00000 100 GiB 27 MiB 248 KiB 1 KiB 26 MiB 100 GiB 0.03 1.00 71 up 2026-02-17T08:30:51.474 INFO:tasks.workunit.client.0.trial072.stdout: 4 ssd 0.09769 1.00000 100 GiB 27 MiB 248 KiB 1 KiB 26 MiB 100 GiB 0.03 1.00 71 up 2026-02-17T08:30:51.474 INFO:tasks.workunit.client.0.trial072.stdout: TOTAL 500 GiB 133 MiB 1.2 MiB 7.8 KiB 132 MiB 500 GiB 0.03 2026-02-17T08:30:51.474 INFO:tasks.workunit.client.0.trial072.stdout:MIN/MAX VAR: 1.00/1.00 STDDEV: 0 2026-02-17T08:30:51.481 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:170: TEST_balancer2: ceph osd df --format=json-pretty 2026-02-17T08:30:51.481 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:170: TEST_balancer2: jq '.nodes[0].pgs' 2026-02-17T08:30:51.668 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:170: TEST_balancer2: PGS=71 2026-02-17T08:30:51.668 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:171: TEST_balancer2: test 71 -ge 70 2026-02-17T08:30:51.669 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:172: TEST_balancer2: ceph osd df --format=json-pretty 2026-02-17T08:30:51.669 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:172: TEST_balancer2: jq '.nodes[1].pgs' 2026-02-17T08:30:51.854 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:172: TEST_balancer2: PGS=71 2026-02-17T08:30:51.854 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:173: TEST_balancer2: test 71 -ge 70 2026-02-17T08:30:51.855 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:174: TEST_balancer2: ceph osd df --format=json-pretty 2026-02-17T08:30:51.855 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:174: TEST_balancer2: jq '.nodes[2].pgs' 2026-02-17T08:30:52.042 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:174: TEST_balancer2: PGS=70 2026-02-17T08:30:52.043 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:175: TEST_balancer2: test 70 -ge 70 2026-02-17T08:30:52.043 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:176: TEST_balancer2: ceph osd df --format=json-pretty 2026-02-17T08:30:52.043 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:176: TEST_balancer2: jq '.nodes[3].pgs' 2026-02-17T08:30:52.233 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:176: TEST_balancer2: PGS=71 2026-02-17T08:30:52.234 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:177: TEST_balancer2: test 71 -ge 70 2026-02-17T08:30:52.234 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:178: TEST_balancer2: ceph osd df --format=json-pretty 2026-02-17T08:30:52.234 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:178: TEST_balancer2: jq '.nodes[4].pgs' 2026-02-17T08:30:52.421 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:178: TEST_balancer2: PGS=71 2026-02-17T08:30:52.421 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:179: TEST_balancer2: test 71 -ge 70 2026-02-17T08:30:52.421 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:181: TEST_balancer2: create_pool test2 132 2026-02-17T08:30:52.422 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test2 132 2026-02-17T08:30:52.666 INFO:tasks.workunit.client.0.trial072.stderr:pool 'test2' already exists 2026-02-17T08:30:52.674 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:30:53.676 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:184: TEST_balancer2: OK=no 2026-02-17T08:30:53.676 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:185: TEST_balancer2: seq 1 25 2026-02-17T08:30:53.677 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:185: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:30:53.678 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:187: TEST_balancer2: sleep 5 2026-02-17T08:30:58.679 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: grep 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:30:58.679 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: wc -l 2026-02-17T08:30:58.683 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: COUNT=1 2026-02-17T08:30:58.683 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:189: TEST_balancer2: test 1 = 2 2026-02-17T08:30:58.683 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:185: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:30:58.683 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:187: TEST_balancer2: sleep 5 2026-02-17T08:31:03.685 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: grep 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:31:03.686 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: wc -l 2026-02-17T08:31:03.690 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: COUNT=1 2026-02-17T08:31:03.690 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:189: TEST_balancer2: test 1 = 2 2026-02-17T08:31:03.690 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:185: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:31:03.690 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:187: TEST_balancer2: sleep 5 2026-02-17T08:31:08.692 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: grep 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:31:08.692 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: wc -l 2026-02-17T08:31:08.697 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: COUNT=1 2026-02-17T08:31:08.697 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:189: TEST_balancer2: test 1 = 2 2026-02-17T08:31:08.697 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:185: TEST_balancer2: for i in $(seq 1 25) 2026-02-17T08:31:08.697 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:187: TEST_balancer2: sleep 5 2026-02-17T08:31:13.699 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: grep 'Optimization plan is almost perfect' td/balancer/mgr.x.log 2026-02-17T08:31:13.699 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: wc -l 2026-02-17T08:31:13.702 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:188: TEST_balancer2: COUNT=2 2026-02-17T08:31:13.702 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:189: TEST_balancer2: test 2 = 2 2026-02-17T08:31:13.702 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:191: TEST_balancer2: OK=yes 2026-02-17T08:31:13.703 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:192: TEST_balancer2: break 2026-02-17T08:31:13.703 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:195: TEST_balancer2: test yes = yes 2026-02-17T08:31:13.703 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:197: TEST_balancer2: sleep 10 2026-02-17T08:31:23.703 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:198: TEST_balancer2: wait_for_clean 2026-02-17T08:31:23.703 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:31:23.703 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:31:23.703 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:31:23.703 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:31:23.704 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:31:23.704 INFO:tasks.workunit.client.0.trial072.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:31:23.705 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:31:23.705 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:31:23.705 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:31:23.788 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:31:23.788 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:31:23.788 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:31:23.788 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:31:23.788 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:31:23.788 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:31:23.979 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:31:23.979 INFO:tasks.workunit.client.0.trial072.stderr:1 2026-02-17T08:31:23.979 INFO:tasks.workunit.client.0.trial072.stderr:2 2026-02-17T08:31:23.980 INFO:tasks.workunit.client.0.trial072.stderr:3 2026-02-17T08:31:23.980 INFO:tasks.workunit.client.0.trial072.stderr:4' 2026-02-17T08:31:23.980 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:31:23.980 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:23.980 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:31:24.043 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836515 2026-02-17T08:31:24.043 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836515 2026-02-17T08:31:24.043 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836515' 2026-02-17T08:31:24.043 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:24.043 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:31:24.107 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705698 2026-02-17T08:31:24.107 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705698 2026-02-17T08:31:24.107 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836515 1-38654705698' 2026-02-17T08:31:24.108 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:24.108 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:31:24.169 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574881 2026-02-17T08:31:24.169 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574881 2026-02-17T08:31:24.169 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-55834574881' 2026-02-17T08:31:24.169 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:24.169 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:31:24.231 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411358 2026-02-17T08:31:24.232 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411358 2026-02-17T08:31:24.232 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-55834574881 3-77309411358' 2026-02-17T08:31:24.232 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:24.232 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:31:24.296 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=98784247837 2026-02-17T08:31:24.296 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 98784247837 2026-02-17T08:31:24.297 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-55834574881 3-77309411358 4-98784247837' 2026-02-17T08:31:24.297 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:24.297 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836515 2026-02-17T08:31:24.297 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:24.298 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:31:24.299 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836515 2026-02-17T08:31:24.299 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:24.299 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836515 2026-02-17T08:31:24.299 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836515' 2026-02-17T08:31:24.300 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.0 seq 21474836515 2026-02-17T08:31:24.300 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:24.489 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836513 -lt 21474836515 2026-02-17T08:31:24.489 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:31:25.489 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:31:25.490 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:25.684 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836513 -lt 21474836515 2026-02-17T08:31:25.684 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:31:26.684 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:31:26.685 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:26.876 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836516 -lt 21474836515 2026-02-17T08:31:26.876 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:26.876 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705698 2026-02-17T08:31:26.877 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:26.878 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:31:26.878 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705698 2026-02-17T08:31:26.878 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:26.880 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705698 2026-02-17T08:31:26.880 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705698' 2026-02-17T08:31:26.880 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.1 seq 38654705698 2026-02-17T08:31:26.880 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:31:27.072 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705698 -lt 38654705698 2026-02-17T08:31:27.072 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:27.073 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574881 2026-02-17T08:31:27.073 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:27.073 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:31:27.074 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574881 2026-02-17T08:31:27.074 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:27.075 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574881 2026-02-17T08:31:27.075 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.2 seq 55834574881 2026-02-17T08:31:27.076 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574881' 2026-02-17T08:31:27.076 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:31:27.262 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574881 -lt 55834574881 2026-02-17T08:31:27.262 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:27.263 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-77309411358 2026-02-17T08:31:27.263 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:27.263 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:31:27.264 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-77309411358 2026-02-17T08:31:27.264 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:27.265 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411358 2026-02-17T08:31:27.265 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 77309411358' 2026-02-17T08:31:27.266 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.3 seq 77309411358 2026-02-17T08:31:27.266 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:31:27.461 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411359 -lt 77309411358 2026-02-17T08:31:27.461 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:27.462 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-98784247837 2026-02-17T08:31:27.462 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:27.463 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:31:27.463 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-98784247837 2026-02-17T08:31:27.463 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:27.464 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=98784247837 2026-02-17T08:31:27.464 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 98784247837' 2026-02-17T08:31:27.464 INFO:tasks.workunit.client.0.trial072.stdout:waiting osd.4 seq 98784247837 2026-02-17T08:31:27.465 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:31:27.655 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 98784247837 -lt 98784247837 2026-02-17T08:31:27.655 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:31:27.655 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:27.656 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:27.909 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 250 == 0 2026-02-17T08:31:27.909 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:31:27.909 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:31:27.909 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:31:27.909 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:31:27.909 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:31:27.909 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:31:27.910 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:31:28.115 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=250 2026-02-17T08:31:28.115 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:31:28.116 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:28.116 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:28.368 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 250 = 250 2026-02-17T08:31:28.368 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:31:28.368 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:31:28.368 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:199: TEST_balancer2: ceph osd df 2026-02-17T08:31:28.548 INFO:tasks.workunit.client.0.trial072.stdout:ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS 2026-02-17T08:31:28.549 INFO:tasks.workunit.client.0.trial072.stdout: 0 ssd 0.09769 1.00000 100 GiB 27 MiB 344 KiB 1 KiB 26 MiB 100 GiB 0.03 1.00 150 up 2026-02-17T08:31:28.549 INFO:tasks.workunit.client.0.trial072.stdout: 1 ssd 0.09769 1.00000 100 GiB 27 MiB 344 KiB 1 KiB 26 MiB 100 GiB 0.03 1.00 151 up 2026-02-17T08:31:28.549 INFO:tasks.workunit.client.0.trial072.stdout: 2 ssd 0.09769 1.00000 100 GiB 27 MiB 344 KiB 1 KiB 26 MiB 100 GiB 0.03 1.00 149 up 2026-02-17T08:31:28.549 INFO:tasks.workunit.client.0.trial072.stdout: 3 ssd 0.09769 1.00000 100 GiB 27 MiB 344 KiB 1 KiB 26 MiB 100 GiB 0.03 1.00 150 up 2026-02-17T08:31:28.549 INFO:tasks.workunit.client.0.trial072.stdout: 4 ssd 0.09769 1.00000 100 GiB 27 MiB 344 KiB 1 KiB 26 MiB 100 GiB 0.03 1.00 150 up 2026-02-17T08:31:28.549 INFO:tasks.workunit.client.0.trial072.stdout: TOTAL 500 GiB 133 MiB 1.7 MiB 7.8 KiB 132 MiB 500 GiB 0.03 2026-02-17T08:31:28.549 INFO:tasks.workunit.client.0.trial072.stdout:MIN/MAX VAR: 1.00/1.00 STDDEV: 0 2026-02-17T08:31:28.556 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:203: TEST_balancer2: expr 150 - 2 2026-02-17T08:31:28.556 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:203: TEST_balancer2: MIN=148 2026-02-17T08:31:28.557 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:204: TEST_balancer2: expr 150 + 2 2026-02-17T08:31:28.558 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:204: TEST_balancer2: MAX=152 2026-02-17T08:31:28.558 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:205: TEST_balancer2: ceph osd df --format=json-pretty 2026-02-17T08:31:28.558 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:205: TEST_balancer2: jq '.nodes[0].pgs' 2026-02-17T08:31:28.747 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:205: TEST_balancer2: PGS=150 2026-02-17T08:31:28.747 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:206: TEST_balancer2: test 150 -ge 148 -a 150 -le 152 2026-02-17T08:31:28.748 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:207: TEST_balancer2: ceph osd df --format=json-pretty 2026-02-17T08:31:28.748 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:207: TEST_balancer2: jq '.nodes[1].pgs' 2026-02-17T08:31:28.931 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:207: TEST_balancer2: PGS=151 2026-02-17T08:31:28.931 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:208: TEST_balancer2: test 151 -ge 148 -a 151 -le 152 2026-02-17T08:31:28.932 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:209: TEST_balancer2: ceph osd df --format=json-pretty 2026-02-17T08:31:28.932 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:209: TEST_balancer2: jq '.nodes[2].pgs' 2026-02-17T08:31:29.118 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:209: TEST_balancer2: PGS=149 2026-02-17T08:31:29.119 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:210: TEST_balancer2: test 149 -ge 148 -a 149 -le 152 2026-02-17T08:31:29.119 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:211: TEST_balancer2: ceph osd df --format=json-pretty 2026-02-17T08:31:29.120 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:211: TEST_balancer2: jq '.nodes[3].pgs' 2026-02-17T08:31:29.303 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:211: TEST_balancer2: PGS=150 2026-02-17T08:31:29.303 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:212: TEST_balancer2: test 150 -ge 148 -a 150 -le 152 2026-02-17T08:31:29.304 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:213: TEST_balancer2: ceph osd df --format=json-pretty 2026-02-17T08:31:29.304 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:213: TEST_balancer2: jq '.nodes[4].pgs' 2026-02-17T08:31:29.493 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:213: TEST_balancer2: PGS=150 2026-02-17T08:31:29.493 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:214: TEST_balancer2: test 150 -ge 148 -a 150 -le 152 2026-02-17T08:31:29.493 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh:216: TEST_balancer2: teardown td/balancer 2026-02-17T08:31:29.493 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/balancer 2026-02-17T08:31:29.493 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:31:29.493 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/balancer KILL 2026-02-17T08:31:29.493 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:31:29.493 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:31:29.493 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:31:29.493 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:31:29.493 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:31:29.601 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:31:29.602 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:31:29.602 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:31:29.603 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:31:29.604 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:31:29.604 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:31:29.605 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:31:29.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:31:29.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:31:29.606 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:31:29.607 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:31:29.607 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:31:29.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:31:29.608 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/balancer 2026-02-17T08:31:29.635 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:31:29.635 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:31:29.636 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:31:29.636 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37242 2026-02-17T08:31:29.637 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:31:29.637 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:31:29.638 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T08:31:29.638 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/balancer 0 2026-02-17T08:31:29.638 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/balancer 2026-02-17T08:31:29.638 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T08:31:29.638 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/balancer KILL 2026-02-17T08:31:29.638 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:31:29.638 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:31:29.638 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:31:29.638 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:31:29.639 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:31:29.639 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:31:29.639 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:31:29.639 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:31:29.640 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:31:29.640 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:31:29.641 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:31:29.641 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:31:29.642 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:31:29.642 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:31:29.642 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:31:29.642 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:31:29.643 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:31:29.644 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T08:31:29.644 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/balancer 2026-02-17T08:31:29.645 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:31:29.645 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:31:29.645 INFO:tasks.workunit.client.0.trial072.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.37242 2026-02-17T08:31:29.645 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.37242 2026-02-17T08:31:29.647 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:31:29.647 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:31:29.647 INFO:tasks.workunit.client.0.trial072.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T08:31:29.647 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T08:31:29.647 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T08:31:29.674 INFO:tasks.workunit:Stopping ['mgr'] on client.0... 2026-02-17T08:31:29.674 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T08:31:30.020 DEBUG:teuthology.parallel:result is None 2026-02-17T08:31:30.020 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T08:31:30.045 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T08:31:30.045 DEBUG:teuthology.orchestra.run.trial072:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T08:31:30.100 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T08:31:30.101 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T08:31:30.115 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T08:31:30.115 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T08:31:30.271 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T08:31:30.282 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T08:31:30.282 DEBUG:teuthology.orchestra.run.trial072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:31:30.298 INFO:teuthology.orchestra.run.trial072.stderr:bash: line 1: ntpq: command not found 2026-02-17T08:31:30.319 INFO:teuthology.orchestra.run.trial072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T08:31:30.319 INFO:teuthology.orchestra.run.trial072.stdout:=============================================================================== 2026-02-17T08:31:30.319 INFO:teuthology.orchestra.run.trial072.stdout:^* LAX.CALTICK.NET 2 6 377 31 -2391us[-2253us] +/- 35ms 2026-02-17T08:31:30.319 INFO:teuthology.orchestra.run.trial072.stdout:^+ 172-233-177-198.ip.linod> 2 6 377 32 -4185us[-4049us] +/- 84ms 2026-02-17T08:31:30.319 INFO:teuthology.orchestra.run.trial072.stdout:^+ 23.186.168.131 2 6 337 30 +461us[ +461us] +/- 55ms 2026-02-17T08:31:30.319 INFO:teuthology.orchestra.run.trial072.stdout:^+ hou1.us.ntp.li 2 6 377 32 +3049us[+3186us] +/- 79ms 2026-02-17T08:31:30.320 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T08:31:30.330 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T08:31:30.330 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T08:31:30.346 DEBUG:teuthology.orchestra.run.trial072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T08:31:30.412 DEBUG:teuthology.orchestra.run.trial072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T08:31:30.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:31:30.439 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T08:31:30.450 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T08:31:30.465 INFO:teuthology.task.internal:Duration was 471.018135 seconds 2026-02-17T08:31:30.465 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T08:31:30.481 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T08:31:30.481 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T08:31:30.517 INFO:teuthology.orchestra.run.trial072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T08:31:30.673 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T08:31:30.673 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial072.front.sepia.ceph.com 2026-02-17T08:31:30.673 DEBUG:teuthology.orchestra.run.trial072:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T08:31:30.734 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T08:31:30.734 DEBUG:teuthology.orchestra.run.trial072:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:31:30.832 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T08:31:30.833 DEBUG:teuthology.orchestra.run.trial072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T08:31:30.857 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:31:30.857 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:31:30.857 INFO:teuthology.orchestra.run.trial072.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:31:30.857 INFO:teuthology.orchestra.run.trial072.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T08:31:30.857 INFO:teuthology.orchestra.run.trial072.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T08:31:30.866 INFO:teuthology.orchestra.run.trial072.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T08:31:30.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T08:31:30.884 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T08:31:30.885 DEBUG:teuthology.orchestra.run.trial072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T08:31:30.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T08:31:30.950 DEBUG:teuthology.orchestra.run.trial072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:31:30.998 INFO:teuthology.orchestra.run.trial072.stdout:kernel.core_pattern = core 2026-02-17T08:31:31.010 DEBUG:teuthology.orchestra.run.trial072:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:31:31.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:31:31.066 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T08:31:31.083 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T08:31:31.085 DEBUG:teuthology.misc:Transferring archived files from trial072:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51132/remote/trial072 2026-02-17T08:31:31.086 DEBUG:teuthology.orchestra.run.trial072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T08:31:31.146 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T08:31:31.146 DEBUG:teuthology.orchestra.run.trial072:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T08:31:31.193 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T08:31:31.211 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T08:31:31.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T08:31:31.228 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T08:31:31.228 DEBUG:teuthology.orchestra.run.trial072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T08:31:31.249 INFO:teuthology.orchestra.run.trial072.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 08:31 /home/ubuntu/cephtest 2026-02-17T08:31:31.251 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T08:31:31.268 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T08:31:31.308 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/mgr} duration: 471.0181348323822 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T08:31:31.309 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:31:31.435 INFO:teuthology.run:pass